FastMail.FM Status

Due to an error on our side, retrieving email from external POP servers via Pop Links were failing for about 16 hours. Users retrieving via the web interface would have seen a message like:

Retrieved 0 of 5 new messages. Left 1 already downloaded and hold on server for 7 days. 5 error(s)

No email was lost, and attempting the retrieve again will now work and download the messages that weren’t downloaded correctly during previous attempts.

Automatic retrievals were also affected, but again they should now be working correctly and downloading any emails that weren’t downloaded the last time.

We apologise for the inconvenience this caused.

Web services and some imap services are down, we’re investigating.

Update: Web services should be back. One imap server is still down affecting some users. We’re investigating whether it will reboot cleanly or whether we need to failover to replica servers

Update: We’ve failed over all affected users to their replica servers. All users should be able to access their email again now

We’re in the process of applying a database change to filestorage which is taking a lot longer than expected.  During this time any attempts to modify anything in file storage (including uploading or deleting files) will timeout and fail.  We estimate it may take 20 minutes or so for the index creation which is currently blocking updates.

It seems a configuration change we made yesterday broke IMAP logins for some email clients, most noteably Mulberry and Pine. Outlook Express, Outlook & Thunderbird were not affected.

We’ve found the cause of the problem and fixed it, and all email clients should be able to login again.

The web interface was down for about 10 minutes. Everything should be working again now.

Update: Ooops,  things are down again. Seems the software upgrade didn’t quite go so well. We’re undoing the upgrade.