Technology

Apache Spark Connect

1 synchronized story carry this tag.

SageMaker Unified Studio adds EMR Serverless notebooks

AWS made Amazon EMR Serverless available as an Apache Spark Connect runtime inside SageMaker Unified Studio notebooks. Teams can select an EMR Serverless application from the notebook compute panel and run PySpark or Spark SQL while using SageMaker Data Agent for code and execution-plan generation.

Why it matters: Data teams can keep interactive AI-assisted analysis in a governed Studio project while moving Spark execution to a serverless runtime instead of provisioning notebook clusters.

Read storyOriginal source · aws.amazon.com