FastMail.FM Status

Status (by robm at Tue Feb 9 05:33 UTC)
Yesterday we made some upgrades to some internal authentication modules. We rolled these changes out to all our servers.

Unfortunately due to an interaction with the old code branch running the old web interface, this caused a compatiability problem with the authentication process, causing all logins to unfortunately fail.

We’ve now fixed this, so logins to the old interface are working again.

If possible, we recommend people use the new web interface if possible. The old web interface is not getting updates any more, and all new features and updates are being done on the new web interface.

Status (by brong at Fri Feb 5 03:13 UTC)
One of our IMAP servers just went offline. I’m investigating the cause, but meanwhile all users are being transferred over to the replica and should be online again in about 2 minutes.

Update (by robm at Fri Feb 5 03:50 UTC)
All services are restored.

Unfortunately when the IMAP server went down, an internal "ping" failure caused a restart attempt on one of our frontend servers which didn’t complete. This meant that for some users, logging into IMAP, POP and SMTP services was failing for a while. This has also been fixed.

Status (by robm at Wed Feb 3 04:51 UTC)
A fix we rolled out about 3 hours ago unfortunately introduced a bug we hadn’t detected before the rollout. The result of the bug was that the web interface was down for about 5 minutes, and also pop retrieves from external servers (via Pop Links a user has setup) were failing for about 1 hour.

The pop retrieve failures were not correctly reported, and instead an "empty" message was delivered to users mailboxes. However no messages were lost in this process, and after the problem was fixed, the messages that previously generated an "empty" message were correctly retrieved.

To avoid confusion, we’ve cleaned up all the "empty" messages from users folders, since the messages contain no information and are just confusing to users now that everything is working again fine and no messages or data were lost.