mysql359.cp.blacknight.com currently down

TrackBacks (0) Comments (0)

Notification Type

Emergency Maintenance

Date

May 16, 2011 8:30 AM

Service Affecting

Yes

Message

Summary: the mysql server known to you as mysql359 or mysql359int is currently down. We're working on a fix for this node now and we hope to have it back up and running before 09:00.

What's affected:

Mysql connections from any web server to:

mysql359.cp.blacknight.com
mysql359int.cp.blacknight.com

Update: 09:08 this node is back online since 08:59. The issue looks to be a deadlocked file system during the nightly backup. The result of this is that lots of processes were hung in "D" state which means waiting for disk. We don't see it too often so it's not a major concern. However we will probably take this node down for maintenance in the not too distant future to do further checks on the disks.

0 TrackBacks

Listed below are links to blogs that reference this entry: mysql359.cp.blacknight.com currently down.

TrackBack URL for this entry: http://www.blacknightstatus.com/cgi-bin/mt/mt-tb.cgi/526

Leave a comment