High Latency and packet loss - Back again (Fixed for now)
Over 4500 ResNet subscribers (previous) :: Newsletter 3 (next)
Since early Sunday morning ResNet traffic is being routed via our backup link. This link does not have our traffic shaping hardware and so the link is getting swamped with P2P traffic.
This is something that cannot be fixed until tomorrow morning when we are back in the office.
We will be working hard this week to locate this reoccurring problem as we understand this causes massive problems to all ResNet connections.
Update: We have restarted the shaper box that fell over and we are investigating reasons for this to try and stop it happening again.
Update Wednesday 8th Nov: this problem has happened several times now over the last few days. Most recently was at 3am 8th Nov.
Depending on when the box falls over, it can be very disruptive to ResNet subscribers, or you may not even notice it. If it happens at a quiet time of day when there is not much traffic on the network (eg mornings) then it isn't a problem. If it happens at the peak time for ResNet usage (late afternoon and evening) then connections will be less reliable, especially for realtime traffic sensitive to packet loss (eg gaming and telephony).
We think the cause is a hardware problem with one of the components in the traffic shaping server. We are trying to isolate the cause and replace the faulty component now.