Date: January 25, 2023
Title: Authentication Service Outage
On January 24th 2023, our authentication service disconnected from our message queuing causing the message queue to back up and preventing the service from picking up new log in attempts. Users already logged in were able to continue using Bloomerang normally but log in attempts during the outage failed.
Our engineers cleared the authentication message queue and enabled additional server resources, relieving the login issues. This incident lasted for ~20 minutes from initial reports to implementing a fix.
Next Steps: Investigate the cause of the authentication service disconnect.