Service Interruptions

You are currently browsing the archive for the Service Interruptions category.

We’ve been informed that some electrical testing will be carried out in January which will disrupt wired and wireless networking in the following locations:

Mon 4th Jan

  • The Hawthornes

Weds 6th Jan

  • 7 Priory Rd
  • Woodland Court
  • 5 Osborne Villas
  • 12 Osborne Villas
  • 16 Osborne Villas
  • 28 St Michaels Park
  • 32 St Michaels Park
  • The Hawthornes

We apologise for the lack of notice, and for the inevitable disruption that this will cause. Unfortunately we don’t yet have any details of how long the disruption will last.

We’ve recently changed the DNS Servers used by ResNet, to some new servers running on some much better hardware.

Most peoples computers have moved seamlessly over to the new DNS servers, but there are less than 20 computers still trying to use the old servers. We’ve done all we can to encourage these computers to start using the new servers but it looks like they’re not configured in our recommended manner so will need manual intervention to move.

The old servers have now been switched off, and when we do so things will break for that small handful of machines. If your ResNet Wired connection stops working, here’s what you need to do.

  1. Reboot your computer. In some cases this will cause it to pick up the new settings automatically
  2. Check your network settings, and make sure you’re set to “obtain DNS server addresses automatically”

If restarting doesn’t work, and your connection is already set to “obtain DNS server addresses automatically” check to see what DNS Servers you’ve been given.

They should start with “137.222.8.x” – if they start with “172.16.67.x” your computer hasn’t picked up the new servers properly. If this is the case, give the IT Service Desk a call, or take your computer along to the Laptop Clinic and we’ll try and help you work out why.

Part of the infrastructure which runs the ResNet back end has developed a hardware fault, some of the services it’s running are currently in a degraded state. We need to move services off it asap.

The following services are affected:

– http://go.resnet.bris.ac.uk – will be unavailable for up to an hour while we move it
– http://my.resnet.bris.ac.uk – will be unavailable for up to an hour while we move it
– DNS (ResNet Wired) will be in a degraded state, and web browsing for 50% of currently connected ResNet customers will be slower than usual
– DHCP (ResNet Wired) will be working, in a non-resilient state
– The ResNet channel in portal.bris.ac.uk will be unavailable for up to an hour while we move it

Various other administrative tools (eg the troubleshooting system used by the Service Desk when troubleshooting ResNet connection problems) will also be affected.

Important: Wireless is not affected at all, so if you’re experiencing wired connection issues – try the wireless.

Updates will follow as we get them.

Update 24th March, 16:15
– http://go.resnet.bris.ac.uk – is now available again
– http://my.resnet.bris.ac.uk – is now available again
– The ResNet channel in portal.bris.ac.uk is now available again
– DNS/DHCP (ResNet Wired) – This is now back in service in a non-resilient manner (both the primary and secondary are on the same hypervisor) which will get us through tonight but isn’t ideal in the long term.

Update 24th March, 16:56
We’ve started to move people onto a new pair of DNS servers to improve resilience and reduce the load on the non-resilient hypervisor. Early indications are that the new servers are performing nicely and that people are moving across to them smoothly as their DHCP lease renews.

Update 25th March, 10:51
The temporary hardware we used to restore service yesterday is overcommitted and while it’s working, it’s at the limit of what it can handle. We will be moving services off it today onto a more permanent home, and we’ll try to minimise downtime while we do so.

Update 26th March, 09:28
Some services are taking substantially longer than expected to migrate. We kicked off the migration of 3 VMs last night, and they’ve still not fully completed. The following services are currently unavailable:
– http://go.resnet.bris.ac.uk – (still migrating)
– http://my.resnet.bris.ac.uk – (still migrating)
– http://www.resnet.bris.ac.uk redirects (the content is still available at http://www.bristol.ac.uk/it-services/advice/homeusers/resnet)

Update 26th March, 11:00
Everything is back up on new hardware.

Update 2014-01-24 10:50am As of about 10:45am the replacement server is up and handling DNS queries so we’re back in business.

Sorry for the disruption!


We had some maintenance scheduled for 9am-10am this morning, which would have resulted in slow DNS performance for a small number of users for a comparatively short amount of time.

Unfortunately we hit some issues, the work over-ran, and then the last stage of the work failed completely rendering a DNS server unbootable.

As a result, ResNet Wired is currently running on only one DNS server.

The server which is missing is the primary for 50% of ResNet, so half of our customers will be seeing slower than usual internet access as it’s taking longer than usual to resolve domain names.

We’re in the process of building a replacement server, and we hope to have normal service restored as soon as possible.

This issue does not affect the wireless network.

This electrical work has been cancelled pending rescheduling
This electrical work has been rescheduled for 15th Feb 2014


Due to essential electrical maintenance work in the Social Sciences block, ResNet Wired and eduroam wireless will be unavailable in the following properties for approximately 6 hours on Saturday 15th Feb 2014.

  • The Hawthorns
  • 1-8 Priory Road
  • 10,67,77,79,97 Woodland Road
  • 28,29,30-33 St Michaels Park
  • Osbourne Villas
  • Woodland Court

In addition to the wired/wireless networking, university provided telephones in those properties will not be available either.

For more details about the wider impact of this work, please see the IT Services news item: http://www.bris.ac.uk/it-services/news/2013/electrical9dec.html

In an effort to resolve some of the wireless coverage problems we’ve been having at Chantry Court, we’ll be replacing all the wireless equipment in the building on Wednesday 11th December 2013.

We’ll be in the building physically replacing all the wireless access points with a higher capacity model, and it’s going to take us a while to get around all 8 floors.  We’ve worked out a process which should minimise the amount of disruption, but you should consider your wireless access to be “at risk” for most of the day.  Wireless access in some flats may be unavailable for up to 2 hours, although we’ll do our best to reduce that as much as possible.

The ResNet Wired network will not be affected by this work, so if you haven’t already done so you might want to activate your wired connection now to ensure you’ve got some form of connectivity while the upgrade is in progress.

Update: 2013-11-12:53 This work is now complete, and all the new equipment appears to be working.

At 12:00, Weds 17th April we lost all connectivity to the Stoke Bishop Halls.  We’re investigating, but currently the following services are not available:

  • ResNet Wired internet access
  • ResNet Wireless internet access
  • Eduroam
  • UOB telephones
  • Halls Admin connections

All residences at Stoke Bishop are offline, including:

  • Hiatt Baker
  • University Hall
  • Badock
  • Churchill
  • The Holmes
  • Durdham
  • Wills Hall
  • Grounds and Gardens Offices
  • Downs Workshop

We don’t have much information, but we’ve got a network engineer on his way to site to see what’s going on.  We’ll update this blog post as and when we get details.

Update Weds 17th, 12:44
It appears that all the fibre runs which connect Stoke Bishop halls back to the main campus have been cut through.  We’re currently trying to locate the position of the break, and will be liaising with our fibre contractor to get a fix put in place.  We don’t have any timescales for a fix at this stage, but will know more when we’ve been in touch with our contractors.  More updates to follow when we have them.

Update Weds 17th, 14:42
We’ve identified the location of the break (which is in the middle of the Hiatt Baker 2 building site) and our contractors are currently digging a bypass trench so they can splice in a repair to the fibre.   They will be laying the bypass duct much deeper than the existing duct, which was surprisingly close to the surface.  If all goes to plan, we’re hoping service can be restored by 7pm, but we’ll continue to update this post when more information becomes available.

We’ve just been sent this photo of the damage:
2013-04-17_small

 

Update Weds 17th, 17:58 (Mark, ResNet Manager)

Netwoking has been restored for all of Stoke Bishop.  Thank you to everyone who helped get this serious loss of service up and running again in a very short period of time – Fibre splicing is not easy!

And a welcome quote from Professor Robert Mayhew, Warden of Churchill Hall:

“Dear Mark,

Just to echo what you said on the Resnet blog, I am really impressed by the speed with which the Networking team managed to resolve this issue. The level of information for staff on the ground was also first class!”

We will be doing some routine maintenance on the Langford Residential Network on:

  • Tuesday 9th April
  • Wednesday 10th April
  • Thursday 11th April
  • Tuesday 16th April
  • Wednesday 17th April
  • Thursday 18th April

Any disruption to the network should be less than 1 minute.

We apologise for any inconvenience this may cause.

See Update 11:16

This morning we lost the network link to Stoke Bishop at approximately 8:20. As a result, ResNet wired & wireless, eduroam and internal phones are not working.

The exact cause of the outage is not yet known, but our networks team is actively working to restore service.

We will post an update here when we have more information.

Update 09:46 by Mark, ResNet Manager – We are very confident this is a power outage in our comms room.  We are now waiting for Estates to visit and restore power to our equipment.

Update 11:16 by Mark, ResNet Manager – Power has been restored by the Estates Team and all networking has been restored to the Stoke Bishop area.

 

Over the coming weeks we will be starting a programme of upgrades to the Residential Network (ResNet).  These upgrades will cause some disruption to subscribers’ Internet connections although these disruptions should be short.  A full list of dates and areas concerned is available below…

  • Completed – Tue 19th Feb 2013, Hawthorns – 15 minute outage from 06:00 for both Wired and Wireless ResNet
  • Completed – Tue 26th Feb 2013, Stoke Bishop Residences – 15 minute outage from 06:00 for both Wired and Wireless ResNet
  • Completed – Tue 5th Mar 2013, Goldney Hall, Clifton Hill House, Manor (Manor House, Richmond House, Sinclair House, Tottenham Place)  – 15 minute outage from 06:00 for both Wired and Wireless ResNet
  • Completed – Tue 12th Mar 2013, Deans, Woodland, Unite, Chantry – 15 minute outage from 06:00 for both Wired and Wireless ResNet
  • Completed – Tue 19th Mar 2013, All other location – 15 minute outage from 06:00 for both Wired and Wireless ResNet

Canceled – In addition to this there will be an outage to ResNet Wireless connections in all locations on Tuesday 5th March 2013 between 07:30 and 09:00.

We apologise for any inconvenience this may cause.

« Older entries