Termsslug: bidirectional-streaming

Bidirectional Streaming

双向流式推理

Real-time inference mode where client and server continuously exchange data over a single connection.

Curated Intelligence

1 items · Page 1/1
AWS Machine Learning BlogT1·Infra
42 pts
AWS Adds Usage-Based Metering for SageMaker Bidirectional Streaming

AWS introduced usage-based metering for Amazon SageMaker AI bidirectional streaming inference, letting model providers bill AWS Marketplace customers for actual consumption during live streams while endpoint infrastructure charges remain separate. Deepgram is the launch partner, bringing usage-based speech-to-text and text-to-speech billing to AWS Marketplace.