Phase 08The API is the constraint385 of 434
Rate limits, retries and the thundering herd you caused
Handle 429s with backoff and jitter, make retries idempotent, and add a queue before your traffic adds one for you.
Build40 minAI implements
Build this in your own editor
This one runs on your machine rather than in the browser workbench. Work to the outcomes below, then come back and mark it complete.
You should now be able to
- Implement exponential backoff with jitter and a retry ceiling
- Avoid double-charging a user for a retried request
- Degrade to a queue or a smaller model instead of failing
Loading…