Storage outage after scheduled maintenance

Incident Report for Flying Circus

Resolved

Between 00:15 and 00:26 our storage was unable to requests for a number of VMs hosted in the HDD class storage pool.

This happened after a regularly scheduled maintenance when two storage daemons did not cleanly reconnect to the cluster and caused requests to be stuck. We have seen this behaviour in the past but considered it resolved after having implemented workarounds. This has been proven untrue and we're now immediately disabling automatic maintenances until a further insights indicate a solution.
Posted May 21, 2026 - 00:00 CEST