Problems / Design a product, hard

Build an AI coding agent backend

Design the backend of a Claude Code-style coding agent from an empty canvas: agent turns that call a model, tools and sandboxes step by step, checkpointed, at a sane token bill.

Unlock it once for 25 credits; everything inside it is free (runs, changes, Submit, results, hints). Sign in with Google to start; new accounts get free credits.

What it must do

Scale

Request types to route: turn (90%, write), resume (10%, read). Budget: $900,000 a month.

Estimate first

The test cases

You start from an empty canvas. When you run the tests, each one simulates your design with its own traffic and failures:

TestWhat it doesPasses when
Normal dayThe normal day: the traffic in the brief, nothing broken.Success ≥ 98%; p99 latency ≤ 8.0 s (turn); p99 latency ≤ 500 ms (resume)
Launch dayAt 5 s a launch triples traffic for 8 s, past the main provider’s rate limit.Success ≥ 95%
The model provider slows downAt 5 s the main model takes 8× longer to start answering, for 8 s (an overloaded region).Success ≥ 97%; p99 latency ≤ 10 s (turn)
Budget: $900,000/monthThe normal day's design must cost at most $900,000 a month.Cost ≤ $900,000/month

Must include

More design a product problems