On February 26, 2025, between 14:51 UTC and 17:19 UTC, GitHub Packages experienced a service degradation, leading to billing-related failures when uploading and downloading Packages. During this period, the billing usage and budget pages were also inaccessible. Initially, we reported that GitHub Actions was affected, but we later determined that the impact was limited to jobs interacting with Packages services, while jobs that did not upload or download Packages remained unaffected.
The incident occurred due to an error in newly introduced code, which caused containers to get into a bad state, ultimately leading to billing API calls failing with 503 errors. We mitigated the issue by rolling back the contributing change. In response to this incident, we are enhancing error handling, improving the resiliency of our billing API calls to minimize customer impact, and improving change rollout practices to catch these potential issues prior to deployment.
Posted Feb 26, 2025 - 17:19 UTC
Update
Actions and Packages are operating normally.
Posted Feb 26, 2025 - 17:19 UTC
Update
We're continuing our investigation into Billing interfaces and retrieval of packages causing Actions workflow run failures.
Posted Feb 26, 2025 - 16:41 UTC
Update
We’re investigating issues related to billing and the retrieval of packages that are causing Actions workflow run failures.
Posted Feb 26, 2025 - 16:17 UTC
Update
We're investigating issues related to the Billing interfaces and Packages downloads failing for enterprise customers.
Posted Feb 26, 2025 - 15:56 UTC
Investigating
We are investigating reports of degraded performance for Actions and Packages