How we made a text-to-speech model respond in sub-50 ms

The Qwen3-TTS 1.7B CustomVoice implementation achieves sub-50 ms p95 time-to-first-audio (TTFA) while maintaining real-time playback on a single NVIDIA H100 SXM, outperforming other implementations. The system produces approximately 630 characters per second at 10 RPS and translates to ~$2 per 1M characters at full utilization. [summary] [comments]