Industries

Data engineering

2 synchronized stories carry this tag.

SageMaker jobs can choose the first available compute profile

Amazon SageMaker AI added ordered instance preference lists for training and processing jobs. A submission can specify alternative instance types and counts, then start on the first configuration with capacity, using on-demand capacity or reserved SageMaker Flexible Training Plans.

Why it matters: Teams no longer need parallel submissions or custom retry loops to search for scarce GPU capacity. The selected hardware can vary between runs, so reproducibility, performance and cost controls must move into job metadata and acceptance tests.

Read storyOriginal source · aws.amazon.com

Google publishes a reproducible agent-authored MLOps pipeline workflow

Google published a runnable Data Agent Kit workflow that uses a declarative orchestration format to generate training, batch-inference and drift-evaluation pipelines, then deploy them to Managed Service for Apache Airflow. The kit integrates with VS Code, Antigravity, Claude Code and Codex and includes pipeline skills plus reference files.

Why it matters: The useful artifact is not a generic agent claim but a complete example spanning authoring, CI/CD, execution, evaluation, branching and troubleshooting. Teams can inspect where generated pipeline code still needs deterministic validation and operational…

Read storyOriginal source · cloud.google.com