Technology

n-gram embeddings

1 synchronized story carry this tag.

Qwen ships Qwen3.8-Flash and experimental Flash-Next weights

Alibaba released managed Qwen3.8-Flash with a default one-million-token context and published Qwen3.8-Flash-Next weights under the Qwen Community 1.0 licence. The experimental multimodal checkpoint uses 125 billion language parameters with 6 billion active, plus 51 billion n-gram embedding parameters, and natively supports 262,144 tokens.

Why it matters: The paired release separates a production API from an inspectable prototype for Qwen4-era sparse attention and n-gram scaling, letting teams test capability, latency, memory, licence, and portability independently.

Read storyOriginal source · huggingface.co