https://yanqian.github.io/tags/realtime/Recent content in Realtime on Armstrong YanHugoen-USThu, 13 Aug 2026 13:59:31 +0800https://yanqian.github.io/posts/publish/building-hey-jarvis-voice-interaction/Thu, 13 Aug 2026 13:59:31 +0800https://yanqian.github.io/posts/publish/building-hey-jarvis-voice-interaction/<p>In <a href="https://yanqian.github.io/posts/publish/building-hey-jarvis/" >the previous article</a>, I wrote about how quickly the first Hey Jarvis Pipeline—a serial voice-processing flow—met my original requirements.</p> <p>I would say, “Hey Jarvis.” It would record my question, send it to the AI, and read the answer aloud.</p> <p>On a flowchart, the voice assistant looked finished.</p> <p>But once I started using it, I discovered that the hardest parts of voice interaction often had little to do with what the system recognized or how it responded. The more fundamental questions were harder to answer: When does it start listening? When does it stop? Can it distinguish my voice from its own? And when the conversation ends, who gets the microphone back?</p>