Due to some issues with connecting to a third party service Neo4j Aura Console (console.neo4j.io) was down between 2023-04-10 21:18:55 UTC and 2023-04-10 23:37:25 UTC.
Upstream requests from the Aura Console to a third party service began to take a long time to respond, resulting in server processes being killed and restarted repeatedly.
Customers were unable to gain access to the Aura Console to manage and monitor database instances.As reported at the time, this issue did not affect running databases and customers could still connect to them using Cypher Shell or their chosen driver. Also connection via Bloom & Browser was possible using the appropriate URLs.
Third party services dependencies built into the Aura Console have been checked and are now running well. We are closely monitoring the situation to detect any degradation.
A number of remediating actions have been identified that could help to avoid this happening again in future and improve incident handling should it occur again.
Preventative
All upstream requests without implemented timeouts are being configured to add a threshold, to limit the chances of non-responsive services from bringing the Console down.
Observability
Improved logging observability so any future issues are easier to detect and faster to resolve.