Reference-grade guide to routing LLM requests across models by cost/latency/quality, escalating hard tasks, and surviving provider failures with multi-provider fallback, circuit breakers, hedging, and honest degraded-mode UX. Use when choosing which model serves a request, building a router/cascade,
Reference-grade guide to routing LLM requests across models by cost/latency/quality, escalating hard tasks, and surviving provider failures with multi-provider fallback, circuit breakers, hedging, and honest degraded-mode UX. Use when choosing which model serves a request, building a router/cascade, adding fallback for outages/ratelimits/timeouts, or designing what the user sees when you degrade.
Questa voce non pubblica alcun pacchetto npm, quindi Forge non ha un albero delle dipendenze per essa. È una lacuna di copertura, non l'affermazione che non abbia dipendenze.