Notice history

May 2023

Jun 2023

Jul 2023

May 2023

Jun 2023

Jul 2023

May 2023

Jun 2023

Jul 2023

May 2023

Jun 2023

Jul 2023

May 2023

Jun 2023

Jul 2023

May 2023

Jun 2023

Jul 2023

Resolved
July 24, 2023 at 6:19 PMUTC
Resolved
July 24, 2023 at 6:19 PMUTC
Build service is restored.
Investigating
July 24, 2023 at 6:14 PMUTC
Investigating
July 24, 2023 at 6:14 PMUTC
We're currently investigating an issue causing builds to fail to start.

Resolved
July 20, 2023 at 9:18 PMUTC
Resolved
July 20, 2023 at 9:18 PMUTC
Database service is restored, we are working with our database provider to understand the cause of the outage.
Investigating
July 20, 2023 at 9:13 PMUTC
Investigating
July 20, 2023 at 9:13 PMUTC
We are investigating reports of intermittent database connectivity issues.

Resolved
July 09, 2023 at 5:07 PMUTC
Resolved
July 09, 2023 at 5:07 PMUTC
The fix has deployed, build service is restored.
Identified
July 09, 2023 at 5:01 PMUTC
Identified
July 09, 2023 at 5:01 PMUTC
We have identified the cause and are deploying a fix.
Investigating
July 09, 2023 at 4:56 PMUTC
Investigating
July 09, 2023 at 4:56 PMUTC
We are investigating an incident preventing some build machines from launching.

Resolved
July 06, 2023 at 8:40 AMUTC
Resolved
July 06, 2023 at 8:40 AMUTC
Build service is operational. We are continuing to work with Google Cloud to ensure they have resolved the issue.
Identified
July 05, 2023 at 10:57 PMUTC
Identified
July 05, 2023 at 10:57 PMUTC
Google Cloud started experiencing periodic load balancer failures about 5 hours ago. These failures are causing intermittent issues with build machines acquiring build information. We are monitoring the situation and are working with GCP support to resolve the issue.

Resolved
July 05, 2023 at 1:58 PMUTC
Resolved
July 05, 2023 at 1:58 PMUTC
Build service is restored, we will continue to monitor for any issues.
Monitoring
July 05, 2023 at 1:50 PMUTC
Monitoring
July 05, 2023 at 1:50 PMUTC
The fix has deployed, we are manually restarting any build machines that were affected to apply the fix.
Identified
July 05, 2023 at 1:48 PMUTC
Identified
July 05, 2023 at 1:48 PMUTC
We have identified the issue and are deploying a fix.
Investigating
July 05, 2023 at 1:34 PMUTC
Investigating
July 05, 2023 at 1:34 PMUTC
We are investigating reports of issues acquiring build machines.

Resolved
June 29, 2023 at 10:18 AMUTC
Resolved
June 29, 2023 at 10:18 AMUTC
This incident has been resolved.
Update
June 29, 2023 at 10:00 AMUTC
Update
June 29, 2023 at 10:00 AMUTC
We are rolling out an additional fix to our API to help mitigate this issue.
Monitoring
June 29, 2023 at 9:38 AMUTC
Monitoring
June 29, 2023 at 9:38 AMUTC
We have detected an issue acquiring new build machines. We have deployed a fix and are monitoring recovery.

Resolved
June 22, 2023 at 5:03 PMUTC
Resolved
June 22, 2023 at 5:03 PMUTC
This incident has been resolved.
Monitoring
June 22, 2023 at 4:34 PMUTC
Monitoring
June 22, 2023 at 4:34 PMUTC
We have deployed a fix for machines failing to launch in eu-central. We are monitoring the fix.
Identified
June 22, 2023 at 4:14 PMUTC
Identified
June 22, 2023 at 4:14 PMUTC
We have identified the problem and are working on a fix. This is only impacting builds trying to acquire machines in the eu-central region at the moment.
Investigating
June 22, 2023 at 4:03 PMUTC
Investigating
June 22, 2023 at 4:03 PMUTC
We are investigating an issue with our API that is causing builds to not be able to acquire a machine.

Resolved
June 19, 2023 at 5:34 PMUTC
Resolved
June 19, 2023 at 5:34 PMUTC
This incident has been resolved.
Monitoring
June 19, 2023 at 4:46 PMUTC
Monitoring
June 19, 2023 at 4:46 PMUTC
We have deployed a mitigation and build service is restored.
Investigating
June 19, 2023 at 4:42 PMUTC
Investigating
June 19, 2023 at 4:42 PMUTC
We are currently investigating an incident preventing build machines from being acquired.

Resolved
June 17, 2023 at 8:08 PMUTC
Resolved
June 17, 2023 at 8:08 PMUTC
The upstream issue has been resolved.
Identified
June 17, 2023 at 7:36 PMUTC
Identified
June 17, 2023 at 7:36 PMUTC
A network issue at an upstream service provider is causing API requests to start builds to respond slowly. Build service is still functional. We are monitoring the situation.

https://status.posthog.com/incidents/q12bkzfnzlnr

Resolved
June 13, 2023 at 5:51 PMUTC
Resolved
June 13, 2023 at 5:51 PMUTC
This incident has been resolved.
Monitoring
June 13, 2023 at 5:36 PMUTC
Monitoring
June 13, 2023 at 5:36 PMUTC
Capacity issues appear to be resolved, we will continue to monitor.
Identified
June 13, 2023 at 5:21 PMUTC
Identified
June 13, 2023 at 5:21 PMUTC
Some builds in us-east-1 are failing to start due to capacity issues. We are working with AWS to acquire additional capacity.

No notices reported this month

May 2023 to Jul 2023

Depot - Notice history