Notification Type
Emergency Maintenance
Date
January 15, 2010 7:00 AM
Service Affecting
Yes
Message
A disk within the RAID array on the hardware node PEMVZMPS28 has failed. We are scheduling some emergency maintenance to resolve this as soon as possible.The window for the maintenance will begin at 7:00AM on the 15th of January.
The estimated downtime is no longer than 20 minutes.
The affected nodes are as follows:
81.17.254.64 pemlinweb25.blacknight.com
81.17.254.67 pemlinweb26.blacknight.com
This post will be updated once completed.
Update: This has been completed
Update 10:37: There is currently an issue with the data on these two nodes. When the drive was replaced the wrong drive was removed. This resulted in the dead drive springing back to live this morning.
The drive died on the 10th of January and as a result all data has been reverted back to this date. Our engineers are on route to replace the drive with the one from 8AM this morning. We hope to have this resolved within the next 2 hours.
Update 11:39: This server is being brought offline now to replace the harddrive.
Update 11:54: All services have been restored to the correct disk.
Note: As the faulty hard drive was in the server between the hours of 08:00AM and 11:39AM any changes made to your files on this disk will be lost. We apologies for any inconvenience this may have caused.
Leave a comment