On February 24, 2022 the WorkOS API was unavailable between 16:25 UTC and 17:35 UTC. We recognize that WorkOS sits on a critical path in our customer’s applications, and we sincerely apologize for the disruption of service caused by this outage.

Who was affected?

This issue impacted the majority of incoming traffic to the WorkOS API. Other components like the Dashboard and Admin Portal were also impacted.

What happened?

The root cause was a DNS configuration issue with WorkOS’ upstream hosting provider. A configuration update made a change to a set of ingress DNS records, resulting in incoming network traffic being unable to reach the WorkOS API.

What will we do to mitigate problems like this in the future?

Moving forward, we will be taking steps to increase the number of regions and availability zones to provide increased redundancy in these sorts of situations.

Our upstream hosting provider has also taken steps to prevent further issues with their DNS configuration.