Technology

PrivateLink

1 synchronized story carry this tag.

SageMaker inference routers reach GA for cross-Region model failover

Amazon SageMaker AI inference routers are generally available for real-time endpoints in supported commercial Regions. A routing target can span Regions and accounts, prefer local capacity, shift traffic after endpoint errors and expose the destination and routing reason on each response.

Why it matters: Managed failover can replace application-specific health checks and routing, but it also creates a data-residency, retry and version-consistency boundary across every registered endpoint.

Read storyOriginal source · aws.amazon.com