Our filestorage server has died again. We’re working on fixing it.
Ok – everything should be back except for some recent (past few hours) files. They’ll be syncing in over the next 10 minutes or so.
update: All fixed – all files should now be accessible again.
The file storage server has been restored again
update: due to a bug in the backup script, recently uploaded files were not accessible. This has now been rectified. Symptoms included websites returning 500 errors, ‘SendFile’ errors in the web interface and ’0k’ attachments when attaching from file storage.
File storage is currently down. We’re investigating.
The servers have been rebooted
Two backend servers are currently down and being rebooted.
We’ve been internally changing around some configurations as part of our aim to get our new replicated servers online. We had hoped to avoid any problems, but unfortunately we did create a few such as some FTP and web site issues, some payment problems, and some screens being unaccessible. We did these changes over the weekend to try and minimise the impact on users. We think most of these are resolved now.
Argggg! The file storage server is down, we’re trying to work out what’s going on.
All network connectivity has been restored and all services are running normally again
It appears packets are currently being lost within NYI’s network causing the site to appear down. We’ve contacted NYI to find out what’s going on.
We just had an outage, due to internal network problems. We think this is probably fallout from yesterday’s shenanigans. We’re doing all we can to get these problems sorted out as soon as possible.
