Technology

structured logging

2 synchronized stories carry this tag.

llama.cpp 0.4.1 stabilizes new model, schema and server paths

The signed llama.cpp 0.4.1 release packages Maple 20B-A1B, Tencent Hy 4 preview and Spark2.5 support with Kimi-K3 recurrent-state rollback, structured JSONL logging, stronger JSON-schema and Qwen3-Coder parsing, and a refactored child-process monitor. It also moves ggml to 0.24.0 and removes deprecated loading flags in favor of --load-mode.

Why it matters: A named stable checkpoint consolidates two weeks of fast-moving model, backend, schema and serving work into an auditable version, while the removed flags and broad backend changes make it a migration rather than a drop-in update.

Read storyOriginal source · github.com

llama.cpp hardens accelerator serving and structured tool schemas

Signed llama.cpp prereleases b10919 through b10936 add multi-device Qualcomm Hexagon support, WebGPU and OpenCL correctness fixes, server download-state repairs, an internal JSON-schema representation, structured JSON logging and better complex-type parsing for Qwen3-Coder tool calls. Builds b10932-b10936 also repair cached clang precompiled headers and Jinja integer-property parsing.

Why it matters: The sequence now spans both accelerator correctness and the schema-to-grammar path used for structured tool calls. Local-model operators need to qualify output, tool arguments and observability together instead of treating a successful model load as…

Read storyOriginal source · github.com