Reference-grade guide to routing LLM requests across models by cost/latency/quality, escalating hard tasks, and surviving provider failures with multi-provider fallback, circuit breakers, hedging, and honest degraded-mode UX. Use when choosing which model serves a request, building a router/cascade,
Reference-grade guide to routing LLM requests across models by cost/latency/quality, escalating hard tasks, and surviving provider failures with multi-provider fallback, circuit breakers, hedging, and honest degraded-mode UX. Use when choosing which model serves a request, building a router/cascade, adding fallback for outages/ratelimits/timeouts, or designing what the user sees when you degrade.