Google adds long-context embedding support to vLLM on Cloud TPU
Google integrated TPU support for Qwen3 text and multimodal embedding workloads into vLLM, including tensor alignment, JAX and XLA pre-warming, and a StepPool path that preserves pooling state through chunked prefill and request preemption. Public GKE and AI Hypercomputer recipes cover 8B text and vision-language checkpoints.
Why it matters: Embedding services can now use a common open serving engine across TPU and other accelerators while testing long-context numerical parity. The public recipes make the serving claim reproducible instead of leaving it as a managed-platform promise.