FastMail.FM Status

Status (by robm at Sun Jul 10 11:16 UTC)
It appears a number of servers are currently down, including multiple database and IMAP servers. We’re investigating.

Update (by robm at Sun Jul 10 12:44 UTC)
We’re still trying to work out what exactly is happening.

There appear to be very odd internal network issues causing interconnectivity problems between servers. We’re still trying to isolate and fix.

Update (by robm at Sun Jul 10 14:22 UTC)
All services have been restored. We’re still analysing the full reason for the outage.

Some email has been queued and will be delivered over the next 10-30 minutes. We don’t believe any email was lost or bounced.

Status (by brong at Tue Jul 5 17:05 UTC)
The "oldweb service" has been down for a little over an hour by the looks of things. We’re investigating and fixing now.

Update (by brong at Tue Jul 5 17:31 UTC)
The old web service is now fully operational again. Apologies for the issues, which were caused by incorrect firewall rules being applied.

Status (by robm at Sun Jul 3 01:25 UTC)
About 8 hours ago the database table we use as a store for data while composing emails reached an internal limit (for the technically curious, the primary key column was an int, and it reached it’s maximum value of 2^31, we hadn’t realised that it had got that large over time).

This caused attempts to compose a new email to fail. Our notification systems picked this up and paged us. I quickly determined what the problem was and changed the table to fix it. The sending problem probably lasted for about 30 minutes.

However I forgot that the sending attachments column had a foreign key to the main table, and so attempting to add attachments to a message being composed would also fail. Our current tests didn’t pick up this issue, so adding attachments to a message being composed was broken for about 7 hours. This has also now been fixed.