Products

llama.cpp 0.6.0

1 synchronized story carry this tag.

llama.cpp 0.6 consolidates multimodal and decision APIs

llama.cpp 0.6.0 shipped a signed stable release with mixed token and embedding batches, MTP and deepstack state embeddings, new GLM and Qwen model support, a decision-model endpoint, Hugging Face downloads and Metal and Vulkan attention work.

Why it matters: A stable checkpoint turns a long stream of rolling builds into a bounded upgrade decision for local inference, while widening multimodal, speculative-decoding and constrained-decision surfaces that clients may depend on.

Read storyOriginal source · github.com