Products

llama.cpp b11201

1 synchronized story carry this tag.

llama.cpp tunes CPU and OpenCL paths and reverts a risky context change

Signed prereleases b11192 through b11201 update the HTTP library, add Hexagon binary inspection, add an OpenCL A8 Q8_0 kernel, introduce tiled CPU matrix multiplication for K-quants, repair Jinja compilation and sameas handling, and revert an automatic unified-KV maximum-context adjustment.

Why it matters: The sequence mixes a potentially large CPU throughput change with template correctness and an explicit rollback of context-fitting behavior. Each can affect output, memory or serving reliability on exact workloads.

Read storyOriginal source · github.com