Category Archive: Incident Notification

SDSC Outage Report – Peered networking outage – 28 Apr 2021, 09:50

[Update – 10:16] SDSC Networking reported that no links appear to be down and ongoing campus network maintenance is unlikely to have caused any outages. If you feel that network links to SDSC are out, please contact SDSC Operations. – SDSC Operations was alerted by a peered off-campus institution that some links to CENIC and …

Continue reading »

UCSD Degraded Networking – 15 Apr 2021

[Update 20 Apr – 22:52] Links are operating normally. Future UCSD maintenance will be required to finish the originally scheduled work. — SDSC has been notified that there are some degraded networking paths within the UCSD networking fabric. Some users may see connection problems accessing both UCSD and SDSC resources.

[Resolved] SDSC Outage Notification – Limited Network Connectivity – 16 March 2021, 10:00

[Update – 12:51] SDSC is no longer seeing networking issues to Spectrum customers. Please contact SDSC Support if you continue to experience limited connectivity. [Update – 11:45] SDSC/UCSD networking provider CENIC has informed SDSC that the issue involves Spectrum’s peering with an intermediary, not with CENIC directly. As a result, Spectrum customers may see limited …

Continue reading »

SDSC Outage Report – Datacenter Networking – 1 March 2021,

[Update: 15:10] A small subset of networks within the SDSC data center environment suffered a brief outage when one of our links bounced as part of our ongoing investigation with Juniper technical support.  We are still actively working with the JTAC team to correct our intermittent connectivity, stemming from our route engine crash on 2/9/21.  …

Continue reading »

SDSC Emergency Maintenance – Core Router Maintenance – 25 Feb 2021,

[Update 03:00] All work has been completed. Please contact colosupport@sdsc.edu with any questions or concerns [Update 02:25] Engineers are still working to verify and recover stale NFS mountpoints. Some webpages may be unavailable while the NFS filesystems are unavailable. [Update 01:16] Engineers are still verifying functionality of routes. Some services including project storage and USS …

Continue reading »

Networking issues on 172.25.119.0/26 subnet

[Update: 16:00] Networking engineers implemented a temporary fix to resolve the networking problems. A permanent solution is forthcoming with the planned reboot of the core router this evening. — We are seeing networking issues on the 172.25.119.0/26 subnet which may be causing slowness or missing network packets. SDSC network engineers are investigating the cause of …

Continue reading »

[Resolved] SDSC Outage Notification – Partial Network Outage – 20 Feb 2021, 06:35-09:10 PST

[Update 11:15 PST] Restitution efforts are complete as of 10:45 PST with no lingering issues observed over the past half hour. Please email support@sdsc.edu to report any outstanding issues. —————————————————— SDSC received internal alerts of inaccessible services this morning at 06:35. The issue appears to be isolated to a subset of the SDSC network. The …

Continue reading »

SDSC Outage Notification – Network – 9 Feb 2021, 10:50am

[Update – 11:30] Networking service has been failed back to original hardware and this has resolved the issue. SDSC will be in contact with hardware vendors to investigate and determine root cause. — SDSC has received notifications of inaccessible systems on some subnets. We are investigating and will post shortly with more information.

SDSC Outage Notification – Grafana portal – 20 Oct 2020, 13:10

[Update – 13:20] The issues have been resolved. Please contact SDSC Support with any questions or concerns. We have reports of dashboard errors which engineers are investigating. Updates will be posted to status.sdsc.edu

SDSC Outage Notification – Citrix Services – 13 Aug 2020, 08:15

[Update – 12:48] Citrix service has been restored. Please contact support with any questions or concerns. Citrix remote desktop services are unavailable and the outage is being investigated by engineers. More information will be posted to this location.

Older posts «

» Newer posts