Technology

prefix cache

1 synchronized story carry this tag.

Ollama 0.34.1 stabilizes MLX memory and model-library controls

Ollama promoted 0.34.1 to stable with improved MLX memory handling, a 100-token repeat threshold and explicit errors instead of incomplete output. The release also makes MLX safetensors creation non-experimental, requires llama.cpp tooling for GGUF conversion and quantization, reports model capabilities consistently, deprecates typical_p for newly created models and accelerates /api/tags on large libraries.

Why it matters: The stable release turns the earlier memory and output candidate into an adoptable checkpoint while changing model-creation and sampling compatibility. Faster catalog queries and explicit capabilities can improve automation, but removed creation paths and…

Read storyOriginal source · github.com