Technology

hosted inference

6 synchronized stories carry this tag.

GitHub retires the Spark app-building workbench

GitHub reached the retirement date for the Spark experience on github.com. Existing deployed apps continue to run, but the Spark workbench is no longer the supported editing path; GitHub had already retired the bundled GitHub Models inference service on 30 July.

Why it matters: A deployed Spark app can appear healthy while its editing surface and any `llm()` calls have separately stopped working, leaving code ownership, inference credentials, billing and maintenance unresolved.

Read storyOriginal source · github.blog

Groq shuts down two Llama endpoints outside committed enterprise contracts

Groq's 16 August shutdown date arrived for `llama-3.1-8b-instant` and `llama-3.3-70b-versatile` on free and developer tiers. Groq recommends `openai/gpt-oss-20b` for the 8B endpoint and `openai/gpt-oss-120b` or `qwen/qwen3.6-27b` for the 70B endpoint.

Why it matters: Calls pinned to either retired ID can fail outside the stated enterprise exemption. Every suggested replacement changes the model family and can change output behavior, tool use, JSON validity, latency, rate limits, and cost.

Read storyOriginal source · console.groq.com

River AI raises $1.1 billion to scale custom open-model training

River AI raised a combined $1.1 billion across seed and Series A financing led by General Catalyst and AMP PBC, with strategic participation from NVIDIA and AMD Ventures. Igor Babuschkin's startup offers LoRA fine-tuning and reinforcement learning for open-weight models through an API with customer-owned weights.

Why it matters: The financing backs a bet that enterprises will pay for fast, task-specific adaptation and deployment of open models rather than rely only on general-purpose closed APIs.

Read storyOriginal source · river.ai

Claude API retires Sonnet 4 and Opus 4

Anthropic retired `claude-sonnet-4-20250514` and `claude-opus-4-20250514` from its first-party Claude API. Requests to either exact model ID now fail, requiring affected production workloads to move to supported successors and revalidate behavior.

Why it matters: Both IDs can remain embedded in gateways, jobs, fixtures, and fallback chains, creating hard failures at a first-party API boundary.

Read storyOriginal source · platform.claude.com

Gemini 3 Pro Preview shuts down as its alias moves

Google shut down `gemini-3-pro-preview` in the Gemini API and redirected its alias to `gemini-3.1-pro-preview`. Applications using the alias can continue without a hard error while receiving a different preview model with potentially different behavior.

Why it matters: An alias redirect can silently change model behavior, tool execution, formatting, latency, safety, and cost inside a production workflow.

Read storyOriginal source · ai.google.dev

Claude API retires Sonnet 3.7 and Haiku 3.5

Anthropic retired `claude-3-7-sonnet-20250219` and `claude-3-5-haiku-20241022` from its first-party Claude API. Requests to either model ID now fail, requiring affected applications to choose and validate a supported successor rather than depend on automatic compatibility.

Why it matters: Hidden references to either model ID can turn stable production workflows into request failures at this provider-specific lifecycle boundary.

Read storyOriginal source · platform.claude.com