January 2012 Archives

Pemlinweb 95 to 98 Down.

TrackBacks (0) Comments (0)
The following linux shared servers are currently down:

  • pemlinweb95 78.153.215.233
  • pemlinweb96 78.153.215.234
  • pemlinweb97 78.153.215.235
  • pemlinweb98 78.153.215.236

An engineer is on route to investigate now.

UPDATE 00:45: All four pemlinwebs are back up and running. We're currently investigating the cause of the kernel panic that bought them down.



Morgana - Legacy Shared Linux Hosting reboot 22:00

TrackBacks (0) Comments (0)
The legacy shared hosting server Morgana requires a reboot tonight the 24th January at 22:00

Server affected: Morgana

IP's:
81.17.252.60
81.17.252.61
81.17.252.62
81.17.252.63
81.17.252.64
81.17.252.65
81.17.252.66
81.17.252.67
81.17.252.68
81.17.252.69
81.17.252.141
81.17.252.157
81.17.252.171


Scheduled Reboot - Balin - Direct Admin Server

TrackBacks (0) Comments (0)
Legacy shared hosting server Balin with IP address 81.17.252.15 requires a reboot tonight the 23rd January at 22:00.

pemlinweb99 / pemlinweb100 Planned Reboot 18/1/12

The hardware node that pemlinweb99 and pemlinweb100 reside on will be rebooted on the 18/1/12 at 21:00

Whats Affected? Websites on:
Pemlinweb99:  
78.153.215.242
78.153.215.10

Pemlinweb100:
78.153.215.243
78.153.215.93
78.153.215.100
78.153.215.99
78.153.215.105

We will update this page once the reboot has completed.

 

Update 21:30 - the server has developed some file system errors and we're dispatching someone to have a look at these as it will need to be rebooted locally.

Update 22:30 - the server has been rebooted and its RAID array is rebuilding. All services are returning to normal in the meantime.

Update 22:50 - the server has developed some more file system errors and we are in the process of trying to resolve the issue, we don't have any ETA at this time but we will update this status post again as soon as we have more information.

Update 01:00 - we have replaced the RAID controller in the server, and are now syncing the drives. We have taken the precaution of keeping the Linux Shared Hosting servers offline while we are completing this process. ETA is another 45 minutes or so.

Update 01:30 - The raid sync is progressing as expected, with the ETA to have services back up and running within the next 15 minutes.

Update 01:45 - The Linux Shared Hosting servers are back online and all services are returning to normal.

pemlinweb99 & pemlinweb100 unresponsive

The above linux shared hosting servers have become unresponsive. We have dispatched a technician to fix the problem.

Update 02:00 - The problem has been resolved and services are returning to normal.

Windows VPS node pemvzwin11 Updates and Reboot

TrackBacks (0) Comments (0)

We need to reboot the windows VPS node pemvzwin11 to allow some minor updates to be installed.

When: Saturday 14/1/12 22:00

The affected VPS's are:

78.153.196.51
78.153.196.53
78.153.196.54
78.153.196.55
78.153.196.56
78.153.196.59
78.153.196.61
78.153.196.64
78.153.196.67
78.153.196.72
78.153.196.73
78.153.196.76
78.153.196.79
78.153.196.83
78.153.196.146
78.153.196.181
78.153.196.182
78.153.196.183
78.153.196.184
78.153.196.189
78.153.196.190
78.153.196.196

Once the server is back online we will update this status post.

 

Update 22:48 - The server has been rebooted and all VPSs are back online.

pemvzmps67- rebooting

TrackBacks (0) Comments (0)
We are currently experiencing issues with MPS67 hardware node which hosts pemlinweb67 and pemlinweb68 - Services located on the following ips will be affected for a short period
  • 78.153.214.207 ( Exclusive )
  • 78.153.214.198 ( Exclusive )
  • 78.153.215.161 ( Shared )
  • 78.153.214.177 ( Exclusive )
  • 78.153.215.36 ( Exclusive )
  • 78.153.214.202 ( Exclusive )
  • 78.153.214.219 ( Exclusive )
  • 78.153.215.160 ( Shared )
  • 78.153.214.191 ( Exclusive )
  • 78.153.214.238 ( Exclusive )

Update 15:40 : both pemlin servers are now back online


Windows VPS node pemvzwin11 Reboot

TrackBacks (0) Comments (0)
We need to reboot VPS node pemvzwin11 to allow some minor updates to be installed.

When: Wednesday 11/1/12 21:00

The affected VPS's are:

78.153.196.51
78.153.196.53
78.153.196.54
78.153.196.55
78.153.196.56
78.153.196.59
78.153.196.61
78.153.196.64
78.153.196.67
78.153.196.72
78.153.196.73
78.153.196.76
78.153.196.79
78.153.196.83
78.153.196.146
78.153.196.181
78.153.196.182
78.153.196.183
78.153.196.184
78.153.196.189
78.153.196.190
78.153.196.196

Once the server is back online we will update this status post.

Update 21:10: The hardware node has rebooted and the VPS's are now starting

pemlinweb99 / pemlinweb100 down Shared Linux Hosting

TrackBacks (0) Comments (0)
Summary: Due to an issue on pemvzmps94 the above two shared linux hosting linwebs are offline. 

What's affected:

Sites on pemlinweb99/ 78.153.215.242

Sites on pemlinweb100 /78.153.215.243

We'll post more information when it's available here.

Update 01:50: The hardware node has been rebooted and is back online, the servers are starting.

Update 02:05: The servers are now back online

Shared Direct Admin server - Ector down

TrackBacks (0) Comments (0)
We are currently seeing issues with one of our older Direct Admin servers:

Ector.blacknight.ie - 81.17.252.50

We are working to resolve the problem as soon as possible and will update this status again as soon as we have more information.

Update 21:45: Server is now back online

pemwinweb24, 25 and 26 rebooted

TrackBacks (0) Comments (0)
Summary: These 3 virtual machines went offline as the hardware node rebooted, they are coming back online now

The following IPs were on these nodes:
pemwinweb24
81.17.250.61
81.17.250.168
81.17.250.185
81.17.250.210
pemwinweb25
81.17.250.62
81.17.250.169
81.17.250.173
81.17.250.181
81.17.250.202
pemwinweb26
81.17.250.63
81.17.250.171
81.17.250.175
81.17.250.199

We will investigate the cause.

Packet Latency on Dedicated and VPS

TrackBacks (0) Comments (0)
We're currently experiencing some packet latency on our Dedicated and VPS network. Our engineers are working on this issue.

The issue is now resolved and network connectivity is returning to normal.

Cloud1 Dublin interuption

TrackBacks (0) Comments (0)
The management software that controls Cloud1 had a malfunction at approximately 1am this morning. This caused some VMs to reboot, the majority of VMs came back online. However some VM's required manual intervention and most of these are also now back online. We are working with the management software vendor to resolve the issue that caused this problem.

Shared Direct Admin server - Ector down

TrackBacks (0) Comments (0)
We are currently seeing issues with one of our older Direct Admin servers:

Ector.blacknight.ie - 81.17.252.50

We are working to resolve the problem as soon as possible and will update this status again as soon as we have more information.

Update 19:10: Server is now back online

Ragnell server issues

TrackBacks (0) Comments (0)
Legacy shared ragnell.blacknight.ie(81.17.252.110) is currently having issues which is causing it to become unresponsive. We are investigating the issue and will update once we have more information.

UPDATE 08:40 Ragnell is back up and running, and we're currently investigating what caused it to become unresponsive.

Cloud Server issues on 1 node

TrackBacks (0) Comments (0)
One of the hypervisor nodes in the cloud rebooted. The hypervisor node is now back online and the VMs are back online.

PEMVZMPS48 Linux Shared Hosting Issues

TrackBacks (0) Comments (0)
PEMVZMPS48 has become unresponsive and an engineer has been sent to look at it. The following web servers are affected:

    pemlinweb29.blacknight.com (81.17.254.24)
    pemlinweb30.blacknight.com (81.17.254.25)

More updates will be posted here when available.

Update: Servers are now back online

Windows Shared Hosting - Palamedes Reboot

TrackBacks (0) Comments (0)
Our windows shared hosting server Palamedes has been rebooted and is currently coming back online.

Cloud VM CentOS yum upgrade NOTICE.

TrackBacks (0) Comments (0)
Summary: We've found that an upgrade from CentOS 6.0 to 6.2 causes a kernel panic after reboot. This is due to the kernel update changing the virtual device names that the VM has when it boots. Our cloud vendor will be releasing a patch for this in the not too distant future however in the mean time we want to advise people to watch for this. We have put a knowledge base article online with some simple instructions that will help you avoid this issue.

https://support.blacknight.ie/index.php?_m=knowledgebase&_a=viewarticle&kbarticleid=571

To the best of our knowledge this only affects Kernels 2.6.32-220.2.1.el6 and above.