Technology

parallel drafting

1 synchronized story carry this tag.

Tencent releases DSpine draft weights for Qwen3.8-27B

Tencent added Qwen3.8-27B support to DSpine and released an Apache-2.0 draft checkpoint for speculative decoding. The documented SGLang path supports one GPU, as many as eight concurrent requests and 131,072-token target context with workload-specific verification-budget tuning.

Why it matters: The release creates a downloadable acceleration path for a current 27B model rather than only a paper design. Teams can now test whether a small parallel drafter improves their own latency and throughput without changing target-model outputs.

Read storyOriginal source · github.com