Architecture

2 articles

· 2 min read

Does your health check use the same path as your traffic?

A Google Cloud outage severed inter-zone traffic while health checks on a separate address space kept reporting healthy. Probes that avoid the data path measure the wrong thing.

#observability#health-checks#incident-analysis

· 3 min read

What happens when a call has no timeout?

CircleCI's July 2 outage came from connections that never timed out. A slow dependency became an unavailable product, and the review question is which of your calls wait forever.

#resilience#timeouts#incident-analysis