NVIDIA opens ModelExpress for peer-to-peer model weight delivery
NVIDIA released ModelExpress as a Rust component for inference systems. It discovers compatible replicas and prefers direct GPU-to-GPU weight transfer over P2P RDMA, then falls back to object, local or default loaders; it also coordinates one fleet download and can reuse compiled kernel artifacts.
Why it matters: Large checkpoints make scale-out, rolling updates and reinforcement-learning weight refreshes data-movement problems. Reusing an already loaded peer can cut cold-start and ingress duplication without changing the model itself.