Shaving a second off a real-time speech-to-LLM pipeline in Electron

Every part of a speech→LLM pipeline is fast enough on its own. Put them in a row and you get three seconds, which is far too slow when a human is waiting for you to say something. I build a desktop ov