Products

SageMaker Inference

1 synchronized story carry this tag.

SageMaker adds production controls for customized Nova models

AWS launched SageMaker Inference for Nova models customized through continued pre-training, supervised fine-tuning or reinforcement fine-tuning. Teams can choose G5 or G6 instances, configure autoscaling, context length and concurrency, and tune deployment economics instead of using a fixed managed endpoint.

Why it matters: Model customization only becomes operationally useful when teams can control serving hardware, capacity and latency separately from training.

Read storyOriginal source · aws.amazon.com