Technology

Jinja

3 synchronized stories carry this tag.

Transformers 5.22.2 hardens Jinja sandboxing and NCCL setup

Hugging Face Transformers 5.22.2 is a patch release that hardens Jinja sandboxing used by templates and sets device_id only for NCCL in distributed initialization. The maintainer describes it as a security and distributed-systems patch.

Why it matters: Chat-template rendering processes model and application-controlled text close to prompt construction, while distributed device initialization affects multi-GPU reliability. A small patch can therefore have a larger security and serving impact than its…

Read storyOriginal source · github.com

llama.cpp extends accelerator support and hardens failure paths

Signed prereleases b11202 through b11222 add F16 CUDA and larger-width SYCL fast Walsh-Hadamard transforms, CUDA support for Nemotron 3 Puzzle state size 96, tuned CUDA and HIP attention paths, an Adreno Vulkan argsort correction, Jinja dict support, safer grammar failure handling and cleaner RPC option parsing.

Why it matters: The sequence mixes new model and accelerator paths with a correctness fix and replacements for process aborts or configuration side effects. Those changes can affect output validity, server availability and performance on exact hardware.

Read storyOriginal source · github.com

llama.cpp tunes CPU and OpenCL paths and reverts a risky context change

Signed prereleases b11192 through b11201 update the HTTP library, add Hexagon binary inspection, add an OpenCL A8 Q8_0 kernel, introduce tiled CPU matrix multiplication for K-quants, repair Jinja compilation and sameas handling, and revert an automatic unified-KV maximum-context adjustment.

Why it matters: The sequence mixes a potentially large CPU throughput change with template correctness and an explicit rollback of context-fitting behavior. Each can affect output, memory or serving reliability on exact workloads.

Read storyOriginal source · github.com