HyperPod adds cross-region inference routing and managed cluster controls
AWS launched a HyperPod Global Inference Gateway that routes one OpenAI-compatible endpoint across clusters and Regions using capacity, queue, proximity and error signals. It also added managed Slurm extensions and EKS or Slurm observability for GPU, network, job and cluster diagnostics.
Why it matters: Routing, failover, software convergence and GPU fault visibility become managed control-plane functions instead of separate operator-built systems, changing both resilience and lock-in decisions for self-hosted inference.