AWS and vLLM share GPUs across dozens of fine-tuned models
AWS published an open multi-LoRA serving path for mixture-of-experts models on SageMaker AI and Bedrock, swapping small adapters while base weights remain loaded.
Why it matters: Sharing a base model across adapters can turn lightly used custom models from dedicated GPU deployments into a denser, more economical serving pool.