Previous incidents

2 separate outages were reported by our monitoring for our API components on 10/04/2025 at 5:07 - 5:09 and 5:37 - 5:40 (BST).
Total time was 5 minutes.
These outages were due to connectivity issues with one of our database servers.
Root cause of the issue was scheduled patching of the database server by our managed service provider (AWS). As a result the server was unavailable for 1 - 2 minutes whilst the failover occured.

The incident has been resolved and we are working on uncovering the root cause.

Update: Root cause was identified as an overloaded redis server component. A large key was identified as the cause of increased network bandwidth and latency of the redis server, decreasing performance and impacting downstream services such as our API components. This key has since been removed and additional logging added to allow us to catch similar incidents in the future.