Learning on Web Dev Open is free for all.

AI-Native Products > The API is the constraintLatency Budget
Phase 08The API is the constraint388 of 434

Latency Budget

Split a budget across the stages of a request without cheating physics. The same discipline, now with a model call in the chain.

Drill20 minAI off

Latency Budget

Split 200ms across DNS, TLS, TTFB, download and render without cheating physics.

Play Latency Budget

You should now be able to

  • Allocate a latency budget across stages
  • Recognise which stages you can actually influence
Ask the community

Loading…

← PreviousChoosing a model is an engineering decisionThe API is the constraintNext →Streaming is a protocol, not a vibeStreaming, and designing for wrongness