[Update – 22:05] Upstream network service providers have reconfigured networking and the issue appears to be resolved. Please contact SDSC Operations with any questions or concerns — SDSC Network Engineers are investigating a loss of external network connectivity. More information will be posted here.
Category Archive: Emergency Maintenance
Emergency Maintenance announcements
SDSC/UCSD Outage Notification – Network Connectivity – 12:35, 2 Mar 2023
SDSC and UCSD have experienced two brief network disruptions that appear to be caused by routing issues outside of campus. The mechanisms SDSC and UCSD have to adaptively restore connectivity worked within a few minutes, but similar outages may happen again until the root cause is resolved. Issue Resolved. If experiencing any issues, please contact …
SDSC Outage Notification – Network outage/maintenance – 15 Dec 2022, 07:00 PST
[Update – 21:32, 20 Dec 2022] SDSC Network Engineers continue to work with customers and vendors to ensure ongoing reliability of network updates. Any additional work affecting general SDSC hosts will be posted as a separate maintenance request. [Update – 15:33] Tonight, 15 December 2022 between 21:00 and midnight, SDSC will be performing emergency maintenance …
SDSC Emergency Maintenance – USS and Project Storage Hotels – 3 November 2022, 13:00-14:00
On Thursday November 3rd 2022 at 13:00 the top-of-rack switch groups that provide access to USS and Project Storage Hotels will be rebooted to resolve an intermittent issue. The maintenance is not expected to cause an outage as redundant paths to the storage will remain online. [update – 2:07pm] The maintenance is complete. Please contact support …
SDSC East Datacenter – Increased temperatures – 10:50, 2 Aug 2022
The SDSC East Datacenter is experiencing higher than usual ambient temperatures. Engineers are working to resolve the issue and more information will be posted here. Update: This morning during building fire testing, there was an issue with the fire dampeners on the air handler units that caused a portion to power down. The dampeners were …
[Resolved] SDSC Outage Notification – Limited Network Connectivity – 16 March 2021, 10:00
[Update – 12:51] SDSC is no longer seeing networking issues to Spectrum customers. Please contact SDSC Support if you continue to experience limited connectivity. [Update – 11:45] SDSC/UCSD networking provider CENIC has informed SDSC that the issue involves Spectrum’s peering with an intermediary, not with CENIC directly. As a result, Spectrum customers may see limited …
SDSC router card replacement, 11 Mar 2021 – 2000-2100
[Update 20:35] The replacement is complete and all links are up. — We have received the replacement line card for our back up router (from the failure on Saturday night), and have scheduled installation for this Thursday evening. This procedure is expected to be transparent to all users, and only bring back into service some …
SDSC Network Core maintenance – Saturday, March 6, 2021 1700-0000 PST & Sunday, March 7, 2021 1700-2200 PST
[Update – 23:58] All maintenance is complete and we are CANCELLING the maintenance window for 7 March 2021. There was a card failure in the backup router for which we have a replacement in process. Once that arrives at the datacenter we will announce a replacement time — we expect no disruption as this is …
SDSC Emergency Maintenance – Core Router Maintenance – 25 Feb 2021,
[Update 03:00] All work has been completed. Please contact colosupport@sdsc.edu with any questions or concerns [Update 02:25] Engineers are still working to verify and recover stale NFS mountpoints. Some webpages may be unavailable while the NFS filesystems are unavailable. [Update 01:16] Engineers are still verifying functionality of routes. Some services including project storage and USS …
SDSC Emergency Maintenance – Firewall/network reconfiguration, 19:00,
[Update – 19:24] All work has been completed and the firewalls are operating normally. Please contact support if you continue to see any issues. At 19:00 on 1 October 2020 a firewall providing access to various SDSC services will be replaced and configured back into a redundant pair. We anticipate a loss of network connectivity …