Blacknight Hosting Network Statustag:www.blacknightstatus.com,2008-03-17://12010-02-08T18:03:03ZService announcements and related posts from the Blacknight technical teamMovable Type Commercial 4.24-enLinux Shared Hosting Issues: Ragnelltag:www.blacknightstatus.com,2010://1.2782010-02-08T17:46:51Z2010-02-08T18:03:03ZWe are currently experiencing issues with our shared hosting server Ragnell. Our engineers are working on resolving this currently.Update 5:58PM This has been resolved....Brian Kennyhttp://www.blacknight.com Update 5:58PM This has been resolved.
]]>
MySQL Node Migrationtag:www.blacknightstatus.com,2010://1.2772010-02-08T15:50:03Z2010-02-08T22:55:26ZDue to increased traffic we are seeing on one of our MySQL nodes we are going to migrate it to it's own dedicated hardware.The downtime will occur tonight at 22:00, Feb 8th 2010The downtime for the affected node will be...Brian Kennyhttp://www.blacknight.com The downtime will occur tonight at 22:00, Feb 8th 2010
The downtime for the affected node will be no more than 45 minutes.
Update: This work has now been completed. ]]>
Shared Hosting Server: Borstag:www.blacknightstatus.com,2010://1.2762010-02-06T18:27:44Z2010-02-06T18:52:27ZWe are currently experiencing issues with our shared hosting server Bors (81.17.252.40)Our engineers are working on resolving this currently and will update this post once more information is available.Update 6:52PM: This issue has been resolved....Brian Kennyhttp://www.blacknight.com Our engineers are working on resolving this currently and will update this post once more information is available.
Update 6:52PM: This issue has been resolved.
]]>
PEMVZWIN02 - Reboottag:www.blacknightstatus.com,2010://1.2752010-02-06T12:11:13Z2010-02-06T13:17:49ZBrian Kennyhttp://www.blacknight.com The node will be down for no more than 10 minutes per VPS on the server.
Update 12:57: This server has been rebooted now. We are now bringing all VEs back online
Update 13:17: All services are resumed. ]]>
Balin Downtimetag:www.blacknightstatus.com,2010://1.2742010-02-04T15:38:44Z2010-02-04T15:42:57ZAt around 15:30 balin.blacknight.ie stopped responding to requests. As we had an engineer on site who also couldn't log in locally, we rebooted it straight away and it was back up by 15:40. While we don't know exactly what caused...Niall Doneganhttp://blog.moybella.net While we don't know exactly what caused the issue yet, it looks like server was run out of memory, possibly due to a massive surge of queries to MySQL. ]]>
Windows Shared Hosting Server Reboottag:www.blacknightstatus.com,2010://1.2732010-02-04T14:17:21Z2010-02-04T14:27:12ZThe server Bediver (81.17.248.30) needs to be reboot urgently.Our engineers are doing this now and the downtime will be no more than 5 minutes.UPDATE: This is complete...Brian Kennyhttp://www.blacknight.com Our engineers are doing this now and the downtime will be no more than 5 minutes.
UPDATE: This is complete
]]>
PemWinWeb09 Issuestag:www.blacknightstatus.com,2010://1.2722010-02-02T17:33:09Z2010-02-02T17:38:59ZPemwinweb09(81.17.250.41) is currently experiencing issues. We're currently looking into it and will update here as soon as we know more.UPDATE 17:38: The server is up and running again and we're currently investigating to find the cause of the outage....Niall Doneganhttp://blog.moybella.net UPDATE 17:38: The server is up and running again and we're currently investigating to find the cause of the outage. ]]>
PHP Upgrade On Gorlois, Priamus And Rivalintag:www.blacknightstatus.com,2010://1.2712010-02-01T17:03:20Z2010-02-02T08:55:32ZThere will be an upgrade of the PHP versions on Gorlois, Priamus and Rivalin to PHP 5.2.12 this evening in order to fully sort an issue we've been having with Installatron. There should be only a few seconds downtime required...Niall Doneganhttp://blog.moybella.net UPDATE: 18:10
All three servers have been successfully updated. Gorlois' had slightly more downtime than expected as an automated process restarted Apache in the background while PHP was being updated. This caused PHP to stop working for about 2 minutes.
UPDATE: 08:52 Tuesday Feb 2nd
As mentioned above the server Gorlois had some additional knock on problems after this upgrade. During the compile of PHP exim decided that it wouldn't accept e-mail from outside. This wasn't caught until the alerting system sent it's first reminder about the service being down some time after. Gorlois' SMTP service came back at 20:17 last night and people were able to send e-mail again and e-mail from outside started to flow. We don't believe any e-mail was lost during this window. ]]>
MySQL Connectivity Errortag:www.blacknightstatus.com,2010://1.2702010-01-29T19:24:43Z2010-01-29T19:26:53ZWe experienced some issues with one of our mysql nodes at 19:35. Some users may have seen connection timeout errors on their database connections for a peroid of 3/5 minutes.The affected node was: mysql71.cp.blacknight.comThis has been resolved now and normal...Brian Kennyhttp://www.blacknight.com The affected node was: mysql71.cp.blacknight.com
This has been resolved now and normal service is restored.
]]>
MySQL Node Migrationtag:www.blacknightstatus.com,2010://1.2692010-01-27T18:24:24Z2010-01-27T22:59:52ZDue to a hardware upgrade we are migrating the MySQL node listed below to new hardware this evening. All details are listed belowWhen?The downtime will occur tonight at 22:00 hours, 27th of January 2010What will be offline?Any databases located on...Brian Kennyhttp://www.blacknight.com When? The downtime will occur tonight at 22:00 hours, 27th of January 2010
What will be offline? Any databases located on these servers: mysql360.cp.blacknight.com mysql360int.cp.blacknight.com
For how long? The downtime will last an hour.
We will update this post once completed.
Update 23:00
This update completed at 22:24. This mysql server node is now live on a new hw node and is already showing better performance for customers using it. ]]>
PHP Upgrade On Ragnelltag:www.blacknightstatus.com,2010://1.2682010-01-27T15:38:17Z2010-01-27T18:11:51ZDue an issue with Installatron, we have to upgrade the version of PHP on Ragnell to 5.2.12. This shouldn't result in any downtime, but it is possible. Any downtime should be no more than a minute or two.UPDATE 18:11This upgrade...Niall Doneganhttp://blog.moybella.net UPDATE 18:11
This upgrade has been completed and the issue with Installatron is now resolved.
]]>
Network Outage for some vlans in InterXiontag:www.blacknightstatus.com,2010://1.2672010-01-25T15:41:54Z2010-01-25T16:08:11ZSummary: At 3:35 pm we started experiencing routing issues in one of our facilities. I.e. InterXion. We're working as fast as possible to resolve this routing issue and we hope to have it backup ASAP.Update: 15:50 Any connectivity coming in...Paul Kellyhttp://www.blacknight.com Update: 15:50 Any connectivity coming in via INEX LAN2 and Cogent was unavailable. This issue affects AS39122 in it's entirety, i.e. not InterXion only. Both DEG and InterXion customers are affected due to the nature of this issue.
Update: 15:58 The issue has been resolved. The cause and the fix will be documented and we'll publish a full RFO when it's available.
Update: 16:05 Services affected by this issue were: Colo/Dedicated networks in Deg and InterXion, Shared hosting lans 81.17.252.0/22, 81.17.248.0/22, Control panel access to cp.blacknight.com, Hosted Exchange services, Qmail mail cluster, Transit customers in DEG and InterXion ]]>
PEMVZWIN04 - Server Issuestag:www.blacknightstatus.com,2010://1.2662010-01-21T11:15:49Z2010-01-21T12:03:03ZWe are currently seeing some template issues on the server PEMVZWIN04. We are working with our software vendor to resolve this asap.A reboot will be required.. Estimated downtime for customer VPSs is 15 minutes.This blog post will be kept updated...Brian Kennyhttp://www.blacknight.com A reboot will be required.. Estimated downtime for customer VPSs is 15 minutes.
This blog post will be kept updated during the process.
Update: All VEs are now back online. ]]>
billing system upgrades 21st of Jan 2010tag:www.blacknightstatus.com,2010://1.2652010-01-20T21:20:26Z2010-01-20T21:27:02ZSummary: Tomorrow morning starting at 04:00 our billing system bound within the "billing" tab of cp.blacknight.com is going to be upgraded by 2 minor revisions.Details: During the upgrade our billing system will be unavailable. This means that domain and hosting...Paul Kellyhttp://www.blacknight.com Details: During the upgrade our billing system will be unavailable. This means that domain and hosting purchases, upgrades, licence upgrades and domain contact, name server management will all be unavailable. The upgrade shouldn't take longer than about 2 hours so it will be finished by 6am.
During this window we'll be installing a new build of our own registrar and payment plugins. The payment plugin has no updates but the registrar plugin has some fixes that we've been waiting to deploy.
]]>
VPS Hardware Node Reboottag:www.blacknightstatus.com,2010://1.2642010-01-20T16:08:22Z2010-01-20T16:14:08ZBrian Kennyhttp://www.blacknight.com The maintenance will take place on the 20th of January at 22:00.