High Latency and packet loss (fixed)
ResNet Newsletter 2: Firefox, Spyware & Manage My ResNet (previous) :: Minor Network Outage (next)
Thursday afternoon we started to receive reports of high latency and packet loss on ResNet. It would appear that the main link between ResNet and the internet is having a few problems, and has fallen over to a backup link. Unfortunately, it fell over in such a way that our monitoring software didn't spot it happening!
The backup link doesn't have our sophisticated trafic shaping hardware running on it, and as such the link is being swamped by P2P traffic. Here's a graph:
As you can see, the problems started at about lunchtime on the 26th, and our offsite traffic pretty much doubled! This network congestion explains why people are seeing high latency and packet loss.
Now that we're aware of what's going on, we're working on a fix.
Update: All fixed! Our traffic levels are back to normal again, and the link is now much less congested.