Technology

assisted decoding

1 synchronized story carry this tag.

Transformers 5.18 adds streaming diarization and multimodal runtimes

Hugging Face released Transformers 5.18 with support for Nemotron 3 Diarization, NemotronH Omni, HyperCLOVAX Vision V2 and GTE retrieval encoders. It also adds MoE GGUF and Qwen 3.8 GGUF support, fixes video token counting and assisted decoding, and includes several explicitly marked breaking changes.

Why it matters: The release makes new streaming audio and multimodal checkpoints reachable through a common library while changing model-loading, attention and generation paths. That broadens local experimentation but raises the risk of silent output or memory regressions…

Read storyOriginal source · github.com