Category Archive: Incident Notification

SDSC Outage Notification – SDSC Cloud Compute – 30 Sep 2024, 16:12

[Update – 08:14] Issue has been resolved. Please contact support@sdsc.edu with any concerns or questions. [Update – 19:56] Issue is ongoing and engineers are continuing troubleshooting efforts. SDSC Engineers are investigating API and service issues in the SDSC Cloud Compute environment. This may prevent users from deploying new instances or un-shelving. Additional information will be …

Continue reading »

SDSC Incident Notification – M52 top-of-rack switch reboot – 14:04, 12 Sept 2024

A top-of-rack switch in the M52 area of the datacenter was inadvertently rebooted. The services are back online at this time. Please contact SDSC Operations with any questions or concerns.

SDSC Outage Notification – Networking issue – 12:25, 6 Sept 2024

[update – 13:58] Engineers have isolated the issue and resolved the immediate problems. They are now working with network vendors to address the underlying cause of the outage – SDSC is investigating network issues affecting systems. Updates will be posted here.

SDSC Network Outage / Emergency Maintenance – 15 Aug 2024, 10:00

[Update 15:20] Network appears to be stable — please contact SDSC Operations with any concerns or questions. Networking staff continues to work with vendor technical support. [Update 14:47] Hardware swaps have caused unexpected impact to other networks. The networking team is still investigating and working with vendor technical support. — SDSC Networking is investigating a …

Continue reading »

SDSC Outage Notification – Core Firewall Connection Issues – 12 Jun 2024, 0515

[UPDATE 0610] Firewall issues have resolved. Please contact SDSC Support with any continued interruptions. — SDSC Engineers are aware of connectivity issues involving core firewalls. Many services such as hosted websites and managed systems may be unavailable. We will update with more information.

SDSC Network Interruption – 18 May 2023, 21:00

[Update – 22:05] Upstream network service providers have reconfigured networking and the issue appears to be resolved. Please contact SDSC Operations with any questions or concerns — SDSC Network Engineers are investigating a loss of external network connectivity. More information will be posted here.

SDSC Incident Notification – VM Slowness – 12 Apr 2023, 13:30

(Update – 22:52) Disk load has been reduced by rebalancing array use. Vendor support has been contacted for additional input. — Around 13:30, 12 April 2023 hosted VMs started to experience slow disk access. Engineers are investigating and more information will be posted here.

SDSC Outage Notification – Network outage/maintenance – 15 Dec 2022, 07:00 PST

[Update – 21:32, 20 Dec 2022] SDSC Network Engineers continue to work with customers and vendors to ensure ongoing reliability of network updates. Any additional work affecting general SDSC hosts will be posted as a separate maintenance request. [Update – 15:33] Tonight, 15 December 2022 between 21:00 and midnight, SDSC will be performing emergency maintenance …

Continue reading »

(Resolved) SDSC Outage Notification – SDSC Cloud access – 22 August 2022, 07:15

08:36 – SDSC Cloud authentication has been restored. Please contact support@sdsc.edu if there are any lingering issues. 07:15 – SDSC engineers are investigating SDSC Cloud dashboard and CLI authentication issues. Existing SDSC Cloud instances can still be accessed. Updates will be posted here.

SDSC East Datacenter – Increased temperatures – 10:50, 2 Aug 2022

The SDSC East Datacenter is experiencing higher than usual ambient temperatures. Engineers are working to resolve the issue and more information will be posted here. Update: This morning during building fire testing, there was an issue with the fire dampeners on the air handler units that caused a portion to power down. The dampeners were …

Continue reading »

Older posts «