Products

LiteLLM 1.109.0

1 synchronized story carry this tag.

LiteLLM 1.109 adds mid-stream fallback and crash-safe interaction billing

LiteLLM 1.109 adds continuation fallback after a chat stream fails, crash-resistant billing for background interactions and an RFC 7523 JWT-bearer path for gateway identity. It also enables the Chat UI by default and ships fixes across Bedrock reasoning, MCP auto-execution billing, spend logs, guardrails and streaming event-loop fairness.

Why it matters: Fallback continuity, billing and delegated identity all change gateway truth during partial failure. The release can reduce dropped work, but an apparently continuous answer may span providers and every retry, MCP round and background task still needs…

Read storyOriginal source · github.com