Greedy inference on partial transcripts

Perfect demo. 10/10. Nothing to add. ... just kidding, I always have something to add (sorry). One of the things we do fairly often in Pipecat pipelines is "greedy inference." If you have partial transcriptions you can run the LLM on the partials and just throw away the output … Quote Pratim Bhosale @BhosalePratim · Sep 18 Played around with @typesafeai Jev today, mostly to understand what it does for tool calling. Instead of an LLM deciding what to do, I substituted that part with Jev. My learning is that we will be able to make the agent act before the user finishes the sentence. So far,…