cloudpatterns.appClassroomKatasWhiteboardBlog
Kata

Stop the loop

Modelled on Facebook's 2010 outage, scaled down.

12 minMedium

Members kata

Membership isn’t open yet. One kata or case is open to you now, 1 more with a free account.

The canvas opens for members

The brief

Modelled on Facebook's 2010 outage, scaled down. 450 requests a second ride on a warm cache, and the database sees only a trickle. From second 20 to 30 the sim purges (flushes) the whole cache again and again, standing in for every client throwing away a value it thought was invalid. Unprotected, a database sized for the warm cache is flooded, falls over and never comes back. Keep the database standing so the cache can refill and the site recovers on its own.

What it checks

  1. 1Choose a mitigation: request coalescing, jittered TTLs or early refresh — or a brake (rate limit, circuit breaker, load shedding) in front of the database.

Brush up first