server1 outage

server1 is experiencing the same problem server1 had yesterday, and requires a reboot. We will make a configuration change later today which we hope will resolve this problem (which is related to the oustanding Linux kernel bug that has been causing problems for a while).

Update: the server is back online

server3 outage

server3 is experiencing problems and requires a reboot – some users will not be able to access their email for the next 5 minutes.

Update: the reboot is complete

Outage

We have to reboot one server – there will be an outage for 5 minutes. We’re looking into the cause at the moment.

Update: outage complete. The cause of the outage was that a database became full. We have now added a monitoring process to identify this well before it becomes a problem, in the future.

server4 outage

server4 requires a reboot to fix a system problem. Some users will experience a 5 minute outage.

All back up now.

IMAP/POP outage

IMAP and POP users were unable to access their email earlier today when the front-end mail proxy ran out of memory, and restarted itself, which fixed the problem automatically.

In order to avoid this happening again in the future, we will bring more proxies online today, which will reduce the memory requirement on each machine.

server3 down

Server 3 requires a reboot to resolve a system problem. Some users won’t be able to access their email for about 5 minutes.

Update: outage is resolved, everything working again

Web app outage

The database used for storing web session state has crashed again, and requires a reboot. We have identified the cause of this problem and will have it fixed today. There will be a brief outage while the server is rebooted.

Update: the reboot is complete

Web app outage

There was about a 20 interruption to service from around UTC 14:00 today. We’re currently looking into the cause.

Web app outage

The database used for storing web session state has stopped responding, and requires a reboot. The web site will be unavailable while this is being completed.

Update: the reboot is complete. We are investigating the cause of this problem to ensure it doesn’t happen again.

server4 reboot

server4 requires a reboot again. Some users will have an outage for 5 minutes.

Update: the reboot is complete

Follow

Get every new post delivered to your Inbox.

Join 50 other followers