Monthly Archive: July 2015

SDSC Emergency Maintenance – cavern NFS – 18:00, 29 July 2015

At 18:00 tonight, 29 July 2015, SDSC engineers will reboot the cavern NFS storage. We have made changes to the ZFS memory utilization in an attempt to curb the out of memory errors seen recently.

SDSC Outage Notification – cavern UNIX NFS / UNIX reference systems – 00:24, 29 July 2015

SDSC continues to experience frequent problems with the ‘cavern’ NFS services. Last night the service failed at approximately 00:24 and was recovered at 06:30.

SDSC Outage Notification – cavern UNIX NFS / UNIX reference systems – 11:09, 28 July 2015

Update, 13:12, 28 July 2015: The ‘cavern’ fileserver was frozen. System engineers performed a reboot and service was restored at 11:32. We are investigating the cause of the outages. At approximately 1109 the reference systems relying upon ‘cavern’ NFS have frozen. System engineers are investigating the outage and we will post updates here.

SDSC Outage Notification – cavern UNIX NFS / UNIX reference systems – 13:40, 23 July 2015

Update, 14:08, 23 July 2015: The ‘cavern’ fileserver was frozen. System engineers performed a reboot and service has been restored at 14:07. We will continue to monitor for any remaining service outages At approximately 13:40 the reference systems relying upon ‘cavern’ NFS have frozen. System engineers are investigating the outage and we will post updates …

Continue reading »

SDSC Outage Notification -Project Storage, 21 July 2015

The scheduled maintenance to upgrade ps-c12 project storage nodes to Centos 7 has been completed. We apologize that the outage went longer than the scheduled 1800-2100 window on 21 July 2015. The primary node had errors which required contacting vendor support. After discussion with support engineers we successfully brought the array online at 0831 on …

Continue reading »