All systems operational
We will try to refresh every 5 minutes
Chocolatey.org Website   (?) Chocolatey.org website and packages pages. Operational
Community Package Repository   (?) Provides the functionality to download or push packages to the community repository. The FOSS version downloads packages from here. Operational
Licensed Package Repository   (?) Provides the functionality to download packages for licensed versions of Chocolatey. Operational
Package Validator   (?) Validates packages submitted to the Chocolatey Community Repository. Operational
Package Verifier   (?) Verifies packages submitted to the Chocolatey Community Repository. Operational
Package Scanner   (?) Manages the virus scanning and results from VirusTotal. Operational
Boxstarter.org Website   (?) Boxstarter.org website. Operational

Incident history


✓ Resolved after 3h 39m of downtime

Slow and Intermittent Connection Issues

September 12, 2018 at 2:17 PM

Resolved - After deploying additional resources and monitoring we can confirm that services have returned to normal. (Sep 12, 2018 - 17:56)

Monitoring - We have temporarily deployed additional resources to help alleviate the current connection issues. We continue to work towards a full solution. (Sep 12, 2018 - 16:36)

Update - After investigating we have identified an issue with one of our web servers in the load balancer. We are continuing to work on resolution. (Sep 12, 2018 - 15:23)

Investigating - We’re aware of users experiencing slow and intermittent connections to the website and both package repositories and we are currently investigating. (Sep 12, 2018 - 14:17)

✓ Resolved after 10h 31m of downtime

Package Verifier and Scanner Outage

September 11, 2018 at 9:27 AM

Post-mortem

One of the servers that is provided by a 3rd party was stopped. Contact was made, and the server was restarted.


Resolved - The remote server that is used for verification services has been restarted and all services restarted. (Sep 11, 2018 - 19:58)

Update - There have been no further reports of issues with the systems / services in our previous update and they continue to perform as expected. We are continuing to investigate the issue surrounding the Package Verifier and Scanner. (Sep 11, 2018 - 13:13)

Monitoring - We have performed maintenance on the Chocolatey.org database and currently monitoring the following systems / services:

We are continuing to investigate the issue surrounding the Package Verifier and Scanner. (Sep 11, 2018 - 11:48)

Investigating - We have been alerted to potential issues with the Chocolatey Package feed for some users, have updated added to the affected systems and are currently investigating (Sep 11, 2018 - 10:42)

Investigating - We are currently investigating an issue with the Package Verifier and Scanner. This may lead to the delay of new packages being approved by the Chocolatey Community moderators. (Sep 11, 2018 - 09:27)

✓ Resolved after 6h 30m of downtime

Slow and Intermittent Connection Issues

August 21, 2018 at 4:00 PM

Post-mortem

One of our web servers in the load balancer stopped communicating with Memcached and was querying the database on every request. At 30 Million requests per day, that’s a bit much for a database to handle.


Resolved - We believe all users experiencing issues have been able to connect at this time. (Aug 21, 2018 - 21:20)

Update - Slow and intermittent connections are still being experienced and we continue to investigate. (Aug 21, 2018 - 19:14)

Monitoring - After stopping the Package Validator and Verifier we will continue to monitor the status of the services. (Aug 21, 2018 - 18:57)

Update - We will be temporarily stopping the Package Validator and Package Verifier to reduce load on the website and database. (Aug 21, 2018 - 18:40)

Monitoring - After performing maintenance on the packages database we will continue to monitor the status of the services. (Aug 21, 2018 - 17:02)

Update - The database has been taken down for a short period while we perform maintenance. (Aug 21, 2018 - 16:30)

Investigating - We’re aware of users experiencing slow and intermittent failed connections to the website and to both package repositories. We’re currently investigating. (Aug 21, 2018 - 16:01)