A short downtime occurred during deployment due to a failed migration. This affected all Platform services. Fortunately, this incident was picked up quickly and resolved with a secondary Hot Fix deployment with a fixed migration.

Such issues are rare and fortunately the timing of this issue and speed of resolution prevented too many failures on the Platform.

No data was lost and everything is secure.

An investigation is underway to determine how this issue was not detected before or during deployment. The deployments returned a success status on all services, which is why the deployment wasn’t cancelled.

Our normal process, should a deployment fail, is to immediately cancel the deployment and remove all affected servers from the load balancer. This prevents any downtime and gives us time to investigate. Additional checks need to be implemented into the deployment pipeline to help prevent issues such as this in the future.