Bitbucket has an increased error rate

SUMMARY

On September 25, 2023, between 10:07 UTC and 10:31 UTC, Atlassian customers using Bitbucket Cloud faced significant degradation to its website, APIs, and Git functionality. This event was triggered when our storage vendor experienced an outage at their data center. The incident was detected immediately by our internal monitoring, escalated to the vendor, and fully resolved after 24 minutes.

IMPACT

Customers who were impacted were unable to access the bitbucket.org website, APIs, Pipelines, and Git over HTTPS and SSH during the duration of the incident.

ROOT CAUSE

The incident was caused by an outage at our storage vendor’s data center. This affected our ability to communicate with our storage volumes, backing up our internal services and preventing them from continuing to serve requests.

REMEDIAL ACTIONS PLAN & NEXT STEPS

We know that outages impact your productivity. We are prioritizing the following improvement actions to reduce recovery time, limit impact, and avoid repeating these types of incidents in the future:

• Working with our storage vendor on preventative measures as well as improved detection on their end.
• Improve resilience to reduce widespread customer impact when a subset of infrastructure is impacted.

We apologize to customers whose services were impacted during this incident; we are taking immediate steps to improve the platform’s performance and availability.

Thanks,

Atlassian Customer Support