Temporary Network latency

Message

We experienced an issue today where one of our transit routers had an issue due to the carriers router flapping it's bgp session. We've shut down this BGP session and had a conversation with the carrier about the issue. While bgp was doing it's thing, some people may have noticed some latency or slowness to connect. This was due to the routes moving from 1 ISP to the other.

Currently Global Cross and Cogent are carrying our traffic. Level(3) are out of the picture for the moment.

Further updates will be posted as we have them.

Update: 17:05

Packet Exchange have acknowledged an issue on their network. One of their customers was advertising the Level(3) router IP into the same VLAN we're in. So Level(3) and this other customer were fighting for the IP. This session is still down.

As an interim measure to ensure we continue to offer the same high level of service that our customers are used to we're putting Tiscali back into the loop. So we'll be back to 3 live carriers. This is happening now and Tiscali should be starting to take traffic away from Cogent and Global Crossing.

Further updates will be posted until this issue is resolved.

Update: 14:55 May 21st

Packet Exchange report that this issue is resolved. We've also received an RFO. With this in mind we'll be turning Level(3) back up at 18:30 this evening. This will cause some brief latency while routes re-converge. A final update will be posted once our engineering team confirm everything is ok once we bring this circuit back up.

Update: 20:30 May 21st

Level(3) has been live for the past 2 hours and all is looking well. This is the last update on this particular ticket. We're closing it now.