Earlier this morning, many Buzz users reported that the system was unavailable to them. After researching with our technical teams, we determined that the Buzz platform was operating as expected, but that many users were being impacted by an issue with Cloudflare (https://www.cloudflarestatus.com). Cloudflare reported that a fiber line in the Eastern US was cut earlier this morning which resulted in increased latency and error rates. Their engineers have been actively re-routing traffic to minimize disruption, so impacted Buzz users should be experiencing an improvement with their ability to login and use the system as intended.
Buzz Learning Management System
We are currently investigating reports that the Buzz LMS has become unresponsive. Some users are unable to log in or navigate the platform. This issue has been escalated, and we will provide updates as more information becomes available.
Earlier today, Amazon Web Services (AWS) experienced a widespread service disruption in the US-EAST-1 region, resulting in elevated error rates and slow performance across multiple systems. The issue was traced to an internal subsystem affecting network load balancers and EC2 instance launches.
Because the Agilix Buzz platform is hosted on AWS, these disruptions temporarily impacted Buzz system performance and availability. AWS has since implemented recovery measures, reducing throttles and restoring functionality across affected services. As AWS continues to work through a backlog of queued operations, system responsiveness and performance within Buzz and the API are steadily improving.
Agilix has confirmed that performance levels are increasing as AWS completes recovery efforts, and we will continue to monitor the situation closely to ensure stability and performance remain consistent.
Thank you for your patience and understanding.
We have received widespread reports of system instability due to a major Amazon Web Services (AWS) outage this morning. We are continuing to investigate this issue.
We are troubleshooting reports of slow system response users who are experiencing sluggishness and/or receiving errors when performing various tasks within the system over the last 15-20 minutes.
Buzz has performed a rollback of recent code changes that were deployed earlier today and believe this has resolved the underlying issue, but they have advised that users may encounter some old cache on the server depending on where their specific request is routed. They recommend that users log out and log back in and try again.
We will continue to closely monitor this situation.
Early this morning, some users experienced intermittent issues accessing Accelerate courses. The cause of this behavior has been identified and addressed, and users should no longer be experiencing any issues. Please reach out to us via https://support.accelerate.education if you have any additional questions.
The Buzz platform is fully operational again and users should not experience any ongoing issues.
We are troubleshooting reports of slow system response and errors from multiple users who are experiencing sluggishness and/or receiving a ‘ClientNetworkError’ when performing various tasks within the system.
Buzz has restored performance to their LMS and users should be able to login and access the platform at this time. We have upgraded the system status above, but have flagged a warning on the service because Buzz is still investigating the root cause that impacted system performance yesterday and today. They have cautioned that some users may experience sporadic interruptions until the underlying root cause is fully addressed.
We are investigating reports from multiple users that the Buzz LMS has become unresponsive and users are unable to login and/or navigate in the platform. We are treating this as a severity 1 outage and will provide additional details as those become available.
Update as of 11:30 PST: Buzz is continuing to investigate this issue and has not yet been able to share an ETA on when the system will be fully operational again. See also: https://support.agilix.com/hc/en-us/articles/23259440477588-Performance-Incident-2024-01-29