FastMail.FM Status

Status (by robm at Tue Feb 9 05:33 UTC)
Yesterday we made some upgrades to some internal authentication modules. We rolled these changes out to all our servers.

Unfortunately due to an interaction with the old code branch running the old web interface, this caused a compatiability problem with the authentication process, causing all logins to unfortunately fail.

We’ve now fixed this, so logins to the old interface are working again.

If possible, we recommend people use the new web interface if possible. The old web interface is not getting updates any more, and all new features and updates are being done on the new web interface.

Status (by brong at Fri Feb 5 03:13 UTC)
One of our IMAP servers just went offline. I’m investigating the cause, but meanwhile all users are being transferred over to the replica and should be online again in about 2 minutes.

Update (by robm at Fri Feb 5 03:50 UTC)
All services are restored.

Unfortunately when the IMAP server went down, an internal "ping" failure caused a restart attempt on one of our frontend servers which didn’t complete. This meant that for some users, logging into IMAP, POP and SMTP services was failing for a while. This has also been fixed.

Status (by robm at Wed Feb 3 04:51 UTC)
A fix we rolled out about 3 hours ago unfortunately introduced a bug we hadn’t detected before the rollout. The result of the bug was that the web interface was down for about 5 minutes, and also pop retrieves from external servers (via Pop Links a user has setup) were failing for about 1 hour.

The pop retrieve failures were not correctly reported, and instead an "empty" message was delivered to users mailboxes. However no messages were lost in this process, and after the problem was fixed, the messages that previously generated an "empty" message were correctly retrieved.

To avoid confusion, we’ve cleaned up all the "empty" messages from users folders, since the messages contain no information and are just confusing to users now that everything is working again fine and no messages or data were lost.

Status (by robm at Sun Jan 31 10:42 UTC)
Some email sent over the last 1 hour via SMTP or the webmail interface may have bounced. We’re investigating which email was affected, and will report more details.

Update (by robm at Sun Jan 31 11:41 UTC)
It appears that due to an internal DNS failure, all email sent between Jan 31 05:04 (US EST) and Jan 31 05:42 (US EST) has double bounced and been lost. THis only affected email being sent from FastMail (via SMTP or the web interface) to other systems. Email received by FastMail from other systems was NOT affected.

We’re currently putting together a log of all affected users and email, and will email users with the details of the lost messages.

Status (by robm at Tue Jan 12 17:13 UTC)
Outgoing emails are currently being delayed. No email is being lost, it’s just our outgoing queue does not appear to be flowing to external servers properly. We’re investigating.

Update (by robm at Tue Jan 12 17:32 UTC)
Email is now flowing out again. There’s been a bit of a build up in the queue, so it’ll take another 5 minutes or so until the queue is cleared and sent.

Status (by robm at Thu Dec 3 15:07 UTC)
One IMAP server is down, affecting email service for some users

Update (by robm at Thu Dec 3 15:29 UTC)
Failed over all services, everything working again

Status (by robm at Thu Nov 26 14:26 UTC)
Due to some abuse issues, we’ve currently temporarily disabled all Guest signups. They’ll be back in a day or two

Status (by brong at Tue Nov 24 07:22 UTC)
One of our IMAP servers is down – I suspect at this stage that a cable was knocked out since we have work going on in that cabinet.

Will update as soon as it’s fixed.

Update (by brong at Tue Nov 24 07:30 UTC)
The server is back online, and we’re bringing up IMAP services again now. Nothing was lost.

Status (by robm at Fri Nov 13 03:50 UTC)
The entire web interface is currently down. Should be fixed in a moment

Update (by robm at Fri Nov 13 03:54 UTC)
Web interface should be back online again

Status (by robm at Mon Nov 9 22:55 UTC)
The old web interface (http://www.fastmail.fm/old/) will be down for 5 minutes.