Multimodal, vision & voice
5 questions
- Argue both sides: cascaded ASR plus LLM plus TTS versus a native speech-to-speech model for a production voice agent.senior
- Budget the latency for a real-time voice agent: VAD, ASR, LLM, TTS, network. Where does the time go, and what do you optimise first?senior
- A video summariser samples one frame every three seconds. A customer summary says an export may not have finished, but the recording shows an Export ready toast. What went wrong, and how do you fix it?mid
- When would you use a multimodal model instead of OCR plus an extraction pipeline, and what are its failure modes?junior
- How do you evaluate ASR quality beyond word error rate, and TTS quality when there is no single correct output?senior