SageMaker adds usage metering for bidirectional streaming models
AWS Marketplace can now meter software usage during long-lived SageMaker bidirectional streaming inference sessions. Providers periodically report consumption while endpoint infrastructure remains billed separately; Deepgram is the launch partner for speech-to-text and text-to-speech.
Why it matters: Real-time speech vendors can align software charges with actual streamed usage instead of an hourly software fee. Buyers still pay for provisioned endpoint infrastructure, including idle periods, so total economics remain a two-part calculation.