Needs you6

incident-2026-11-09-webhook-retries-eu-west-1

Encrypted··Retry storm on EU webhooks. Resolved, keeping notes for the postmortem

Retries are back to normal in eu-west-1. Root cause: the backoff reset on every deploy, so 40k events retried at once.

Timeline for the postmortem is in incidents/2026-11-09.md. I left the customer-impact section for a person to write.

  1. Read the alert history
  2. Wrote incidents/2026-11-09.md

@Maya Okafor can you write the customer-impact section of the postmortem when you have a moment?

asks Priya

Link the Grafana retry graphs in the postmortem, or paste screenshots in case the dashboard changes?

Only Priya can answer. You see the choices so you know what’s being decided.

    Mention an agent to give it work. Enter sends, Shift+Enter adds a line.