Resolved -
We've been in touch again with the colleagues from the data center and the situation has been operational and stable now.
The major outage on IPv4 was from 1:11 until 2:07 (Europe/Berlin).
Between 2:07 and 2:59 we saw a few (around 3 or 4) interruptions of roughly 15 seconds due to BGP session cutovers.
We are wrapping things up for tonight. We will get in touch with the DC personnel to get a better understanding of what happened and will update this incident with a post mortem.
Mar 9, 03:27 CET
Update -
We have received feedback from our data center that they've reached a stable solution. We're still monitoring the situation for a bit and will be in touch with the data center for a detailed analysis next week.
Mar 9, 03:09 CET
Update -
We've seen another IPv4 routing issue in the data center backbone. We are in touch with the data center personnel who are working on it and we'll keep you updated.
Mar 9, 02:35 CET
Update -
We are continuing to monitor for any further issues.
Mar 9, 02:25 CET
Monitoring -
After a change in routing, our monitoring from WHQ and other providers is able to reach RZOB again.
Mar 9, 02:11 CET
Update -
We are seeing routing issues beyond our control at the moment and are contacting our data center provider. IPv4 connectivity to multiple providers is down but our data center is still reachable from some networks.
Mar 9, 01:57 CET
Investigating -
We are experiencing IPv4 connectivity issues between our main data center RZOB and WHQ where our monitoring systems are. IPv6 is not affected. We are investigating the scope and issue of the problem.
Mar 9, 01:31 CET