Previous incidents

All queued messages were processed, and normal service levels
resumed.

Our partner has resolved the issue, and the portal and API services are now available.

All outstanding messages in the queues have now been processed, and we are seeing a significant improvement in performance. Updates for the remaining resources will occur as they come back online. Thank you for your patience during this time and apologies for any inconvenience.

Summary: Microsoft applied patches in Azure on Tuesday evening, resulting in estate wide VM restarts. Some services did not correctly start up after the restarts. Monitoring system is setup to alert on this, but none were sent to the out of hours team. Users discovered and reported the issue instead.

Root cause: Our monitoring system’s schedule was not correctly set due to human error, resulting in alerts not sending to our out of hours team. They were unable to respond to the issue as they ...