Depot - Notice history

Connections have dropped back to normal latencies. We will be continuing to monitor for spikes.

The issue is resolved, build service has been restored.

We pinpointed the problematic service and deployed a fix. Build connections are restored, and we are monitoring for connection failures.

We are investigating a failure to reconcile AWS API calls that is resulting in builders failing to launch.

Database connectivity has been restored and all systems have recovered.

We have resolved the database connectivity issue and are monitoring the results.

We have identified an issue with our primary database.

We have rolled out a fix across our API to improve performance.

We have rolled out a temporary fix to improve API performance while we implement a final fix.

We have identified and rolled out a fix to restore builders coming online. We continue to investigate API performance issues in acquiring a builder for multiple concurrent build requests.

This outage is resolved.

We have successfully acquired compute capacity, all service should now be restored. We will continue to monitor.

We have implemented a fix that is bringing builders online again. We are monitoring the situation to verify we have enough capacity while also acquiring more capacity in the background.