Depot - Notice history

The stuck jobs have all processed successfully.

We are observing queue times returning to normal. We will continue to monitor.

We are continuing to see recovery but are continuing to monitor the remaining outliers.

We have deployed a fix and are monitoring for queue time recovery.

We've discovered a failure in our task scheduler that is blocking operations. We're deploying a fix that should unblock jobs.

Queue times have returned to normal.

Build service is restored. The underlying cause was an issue with a certificate / system time in the macOS VM image itself. We have deployed a working image to all macOS hosts.

We are currently deploying a fix to all macOS hosts, build service is beginning to be restored.

We have identified the potential root cause and are working on populating a fix out across the fleet of compute for macOS runners.

Build service has fully restored.

Build and Action jobs are starting to process, we are working through the backlog of jobs from the disruption.

We have deployed a mitigation and are seeing service begin to be restored.

Queue times have returned to normal.

We implemented a fix and are currently monitoring the result. Job are slowly being picked up.