Baseten's Gradium TTS deployment reaches a median 214 ms time-to-first-audio on Coval's benchmark, using Kyutai's Delayed Streams Modeling and GPU optimizations like kernel fusion and CUDA Graphs. The company also details how its delivery network cuts cold starts for bursty voice traffic.
Baseten partners with Runway to offer Gen-4.5 and Aleph 2.0, including fine-tuned versions, in single-tenant environments with dedicated GPU capacity and autoscaling.
Baseten details NVIDIA Nemotron 3 Diarization, an open end-to-end model that labels up to eight speakers at latencies from 0.32 to 30.4 seconds, with presets for batch, streaming, and real-time transcription. Benchmarks show up to 500 concurrent streams per RTX PRO 6000.
We count visits on the server, cookie-free. You can also let this browser tell us how long you read, how far you scroll and which links you follow. It stays with us.