Farm's nas-4-3 has lost contact with its drives
Monitoring - The drives have been rejoined with the NAS, and the shares are working again. A full ZFS verification of the data is currently in progress.
Nov 13, 2026 - 21:34 PST
Identified - Farm's nas-4-3 has lost contact with its drives. This is impacting everyone with a home or group directory on that host. Admins are investigating.
Nov 13, 2026 - 15:05 PST
Storage Array FS7 Offline. HPC@UCD is unable to process new storage orders.
Identified - Our FS7 storage array is currently offline and not responsive. Although FS7 is under a support contract, our vendor has not been responsive or able to fix it since we shipped the device to them. We have placed an order with another vendor to outfit an existing storage system, but the ETA is at least two weeks out.

Please be patient as we are exploring all options for provisioning storage.
Nov 13, 2026 - 11:48 PST
Farm Login and Storage Outage
Update - We are continuing to monitor for any further issues.
Oct 26, 2026 - 10:04 PDT
Monitoring - There is an issue with the Farm home directory server preventing login. We are investigating and monitoring the issue.
Oct 23, 2026 - 08:48 PDT
Quobyte issues accessing some files
Investigating - Admins are working with Quobyte support to resolve some issues that have been reported trying to access specific files, as well as more broad issues that have been impacting some clients.
Oct 23, 2026 - 09:53 PDT
Uptime over the past 90 days. View historical uptime.
Cluster: Hive Operational
Cluster: Farm Operational
Cluster: Franklin Operational
Login Node Operational
Compute Nodes Operational
GPU Nodes Operational
Network Operational
Storage Degraded Performance
Quobyte Parallel File System Degraded Performance
Home Directories Operational
Legacy Storage Operational
Module System and Software Operational
Hippo User Portal Operational
OnDemand Operational
Scheduler (Slurm) Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.

No incidents or maintenance related to this downtime.

Nov 13, 2026

Unresolved incidents: Farm's nas-4-3 has lost contact with its drives, Storage Array FS7 Offline. HPC@UCD is unable to process new storage orders..

Nov 12, 2026

No incidents reported.

Nov 11, 2026

No incidents reported.

Nov 10, 2026

No incidents reported.

Nov 9, 2026

No incidents reported.

Nov 8, 2026

No incidents reported.

Nov 7, 2026

No incidents reported.

Nov 6, 2026

No incidents reported.

Nov 5, 2026

No incidents reported.

Nov 4, 2026

No incidents reported.

Nov 3, 2026

No incidents reported.

Nov 2, 2026

No incidents reported.

Nov 1, 2026

No incidents reported.

Oct 31, 2026

No incidents reported.

Oct 30, 2026

Hive nodes dropping out of Slurm.
Resolved - System administrators have identified the Slurm error as a configuration management issue. We apologize for the configuration error. Those responsible for sacking the people who have just been sacked, have been sacked.
Oct 30, 16:09 PDT
Investigating - We're seeing Hive nodes dropping out of Slurm. These nodes are not going down, but Slurm is not recognizing them. System administrators are looking for the root cause.
Oct 30, 15:08 PDT
Incident History Powered by Atlassian Statuspage