pemlinweb68.blacknight.com 78.153.215.161
pemlinweb67.blacknight.com 78.153.215.160
We will update once this has been resolved.
Update @ 16:30 : pemvzmps67 has returned and the nodes are back up.
Our old dns server at ns.blacknightsolutions.com is currently experiencing issues and is unresponsive. We're attempting a reboot.
ns2.blacknightsolutions.com is up and running, however any changes made in dnsmgr won't be written out until ns.blacknightsolutions.com is back up and running.
Any domain manages from cp.blacknight.com is unaffected.
Update 16:30 - This server is unresponsive after a reboot, and we have dispatched an Engineer to have a look at it.
Update 19:30 - The server is fully back up and running.
- pemlinweb95 78.153.215.233
- pemlinweb96 78.153.215.234
- pemlinweb97 78.153.215.235
- pemlinweb98 78.153.215.236
An engineer is on route to investigate now.
UPDATE 00:45: All four pemlinwebs are back up and running. We're currently investigating the cause of the kernel panic that bought them down.
Server affected: Morgana
IP's:
81.17.252.60
81.17.252.61
81.17.252.62
81.17.252.63
81.17.252.64
81.17.252.65
81.17.252.66
81.17.252.67
81.17.252.68
81.17.252.69
81.17.252.141
81.17.252.157
81.17.252.171
The hardware node that pemlinweb99 and pemlinweb100 reside on will be rebooted on the 18/1/12 at 21:00
Whats Affected? Websites on:
Pemlinweb99:
78.153.215.242
78.153.215.10
Pemlinweb100:
78.153.215.243
78.153.215.93
78.153.215.100
78.153.215.99
78.153.215.105
We will update this page once the reboot has completed.
Update 21:30 - the server has developed some file system errors and we're dispatching someone to have a look at these as it will need to be rebooted locally.
Update 22:30 - the server has been rebooted and its RAID array is rebuilding. All services are returning to normal in the meantime.
Update 22:50 - the server has developed some more file system errors and we are in the process of trying to resolve the issue, we don't have any ETA at this time but we will update this status post again as soon as we have more information.
Update 01:00 - we have replaced the RAID controller in the server, and are now syncing the drives. We have taken the precaution of keeping the Linux Shared Hosting servers offline while we are completing this process. ETA is another 45 minutes or so.
Update 01:30 - The raid sync is progressing as expected, with the ETA to have services back up and running within the next 15 minutes.
Update 01:45 - The Linux Shared Hosting servers are back online and all services are returning to normal.
The above linux shared hosting servers have become unresponsive. We have dispatched a technician to fix the problem.
Update 02:00 - The problem has been resolved and services are returning to normal.
We need to reboot the windows VPS node pemvzwin11 to allow some minor updates to be installed.
When: Saturday 14/1/12 22:00
The affected VPS's are:
78.153.196.51
78.153.196.53
78.153.196.54
78.153.196.55
78.153.196.56
78.153.196.59
78.153.196.61
78.153.196.64
78.153.196.67
78.153.196.72
78.153.196.73
78.153.196.76
78.153.196.79
78.153.196.83
78.153.196.146
78.153.196.181
78.153.196.182
78.153.196.183
78.153.196.184
78.153.196.189
78.153.196.190
78.153.196.196
Once the server is back online we will update this status post.
Update 22:48 - The server has been rebooted and all VPSs are back online.
- 78.153.214.207 ( Exclusive )
- 78.153.214.198 ( Exclusive )
- 78.153.215.161 ( Shared )
- 78.153.214.177 ( Exclusive )
- 78.153.215.36 ( Exclusive )
- 78.153.214.202 ( Exclusive )
- 78.153.214.219 ( Exclusive )
- 78.153.215.160 ( Shared )
- 78.153.214.191 ( Exclusive )
- 78.153.214.238 ( Exclusive )
Update 15:40 : both pemlin servers are now back online