Building an AI Inference Gateway, Part 2: Unifying Streaming and Non-Streaming Processing

Feb 4 · 5 min read · # Building an AI Inference Gateway, Part 2: Unifying Streaming and Non-Streaming Processing Recently, while developing [llm-converter](https://github.com/putao520/llm-converter)—a Rust library for LLM protocol conversion—I encountered a problem: **h...