Technology

GPUDirect Storage

1 synchronized story carry this tag.

NVIDIA opens ModelExpress for peer-to-peer model weight delivery

NVIDIA released ModelExpress as a Rust component for inference systems. It discovers compatible replicas and prefers direct GPU-to-GPU weight transfer over P2P RDMA, then falls back to object, local or default loaders; it also coordinates one fleet download and can reuse compiled kernel artifacts.

Why it matters: Large checkpoints make scale-out, rolling updates and reinforcement-learning weight refreshes data-movement problems. Reusing an already loaded peer can cut cold-start and ingress duplication without changing the model itself.

Read storyOriginal source · developer.nvidia.com