On Monday April 22 at 11:59 our core Signhost application encountered a database connection disturbance. This connectivity issue resulted in an immediate downtime of our signing services.
The database cluster was healthy, although the response times of the query's took longer than expected.
After having noticed the issue occurring we directly tried to analyze what the root cause may be and we've immediately contacted our hosting party to also check their logging for any issues.
Simultaneously we partially put some of our servers in maintenance mode. Once we found out this didn’t work we decided to put all servers in maintenance mode while continuing investigating the slow response times to the database.
After about an half hour we've gradually start bringing the servers online and after an hour- and half we're fully operational again.
Our hosting was performing routine software maintenance on some storage disks. While this should normally not impact the availability of our service, unfortunately it did.