Series · 5 chapters
AI System Design
A reference design for an assistant platform, followed from product guarantees through knowledge, durable execution, load, and controlled change.
Start with architecture- 01
From Request to Architecture
Start AI system design from the guarantees a product must preserve: access, actions, evidence, and survival of interrupted work.
- 02
The Knowledge Layer
Design the knowledge layer so document updates, permissions, and index migrations stay consistent with what the assistant can cite.
- 03
The Execution Layer
Design durable execution so tool timeouts, approvals, and retries leave a clear account of what did and did not happen.
- 04
Load, Queues, and Capacity
Treat queues, capacity, and fallbacks as design choices so latency, overload, and release evaluation stay inspectable.
- 05
Evaluation, Releases, and Change
Design evaluation and release control so changes to models, prompts, retrieval, tools, and policies can be measured, staged, attributed, and reversed safely.