Architecture

3 articles

· 2 min read

Can you operate the system while the dashboard is down?

Cloudflare logged three incidents in one day and kept serving traffic through all of them. A briefing on control planes, data planes, and which one your runbook secretly needs.

#control-plane#availability#operations

· 2 min read

Does your health check use the same path as your traffic?

A Google Cloud outage severed inter-zone traffic while health checks on a separate address space kept reporting healthy. Probes that avoid the data path measure the wrong thing.

#observability#health-checks#incident-analysis

· 3 min read

What happens when a call has no timeout?

CircleCI's July 2 outage came from connections that never timed out. A slow dependency became an unavailable product, and the review question is which of your calls wait forever.

#resilience#timeouts#incident-analysis