---
title: "Discussion on \"Building an AI Inference Gateway, Part 2: Unifying Streaming and Non-Streaming Processing\" | Hashnode"
description: "Discussion on \"Building an AI Inference Gateway, Part 2: Unifying Streaming and Non-Streaming Processing\". # Building an AI Inference Gateway, Part 2: Unifying Streaming and Non-Streaming Processing\n\nRecently, while developing [llm-converter](https://github.com/putao520/llm-converter)—a Rust library for LLM protocol conversion—I encountered a problem: **h..."
url: "https://hashnode.com/posts/building-an-ai-inference-gateway-part-2-unifying-streaming-and-non-streaming-processing/6983042c62c0ca9c41a7faf3"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Building an AI Inference Gateway, Part 2: Unifying Streaming and Non-Streaming Processing](https://www.putao282.com/building-an-ai-inference-gateway-part-2-unifying-streaming-and-non-streaming-processing?utm_source=hashnode&utm_medium=feed)

\# Building an AI Inference Gateway, Part 2: Unifying Streaming and Non-Streaming Processing Recently, while developing \[llm-converter\](https://github.com/putao520/llm-converter)—a Rust library for LLM protocol conversion—I encountered a problem: \*\*h...

Feb 4 · 5 min read · putao282.com  
Read the article

-   [#anthropic-api](https://hashnode.com/tag/anthropic-api)
-   [#ai-gateway](https://hashnode.com/tag/ai-gateway)
-   [#openai-api](https://hashnode.com/tag/openai-api)

## Written by

[Tao Pu](https://hashnode.com/@putao520)

@putao520

  
[View profile](https://hashnode.com/@putao520)

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
