Companies

Red Hat

4 synchronized stories carry this tag.

llm-d 1.0 adds multi-tenant and zero-downtime inference operations

The open llm-d project released version 1.0 with a stable v1 configuration API, priority- and fairness-aware flow control, high-availability routing, revision-aware rolling upgrades for disaggregated serving, topology-aware placement and session- and turn-aware routing for agent workloads.

Why it matters: The release turns distributed inference features such as prefix-aware routing and prefill/decode separation into a more operable shared platform. Platform teams can express tenant priority, preserve request continuity during upgrades and reuse agent-session…

Read storyOriginal source · llm-d.ai

SiFive ships a rackable RISC-V data-center development server

SiFive introduced the BigSky SF-2U870, a limited-quantity 2U development server with 32 P870-D cores, 256 GB DDR5, four PCIe Gen5 x16 slots, NVMe storage, Ubuntu 26.04 and RHEL 10 support. SiFive says CUDA is running on the platform as an NVIDIA-GPU head node and lead customers are already testing deployed systems.

Why it matters: A rackable, enterprise-Linux RISC-V platform gives data-center and AI teams a concrete system for porting, tuning, and validating software before production silicon choices. It is ecosystem evidence, not yet proof of competitive production economics.

Read storyOriginal source · sifive.com

IBM Sovereign Core makes AI location, identity and audit evidence runtime controls

IBM made Sovereign Core generally available with a customer-operated control plane, in-boundary identity, encryption, logs and evidence, continuous compliance monitoring and governed execution for models and agents. The platform is built on Red Hat OpenShift and Red Hat AI with a multi-vendor ecosystem.

Why it matters: Digital sovereignty is expanding from data residency into who operates the control plane, where inference occurs and who holds keys, logs and lifecycle authority.

Read storyOriginal source · newsroom.ibm.com

Mistral 3 spans a 675B sparse flagship and edge-sized models

Mistral released Mistral Large 3, a 675B-parameter mixture-of-experts model with 41B active parameters, plus 14B, 8B, and 3B Ministral 3 models, all under Apache 2.0.

Why it matters: One permissively licensed family covered frontier-scale serving, enterprise customization, laptops, and edge devices, reducing the need to adopt unrelated model stacks for each tier.

Read storyOriginal source · mistral.ai