---
title: "Discussion on \"Multiple Independent Questions: Batch Into One Request or Split Into Many? — An Analysis of LLM Concurrent Processing\" | Hashnode"
description: "Discussion on \"Multiple Independent Questions: Batch Into One Request or Split Into Many? — An Analysis of LLM Concurrent Processing\". When you have 5 unrelated questions, should you pack them into one message to the LLM, or send 5 requests simultaneously? Which is faster?\n\nThe Short Answer\nSplitting into multiple independent parallel requests is almost always faster.\nThis isn't a g..."
url: "https://hashnode.com/posts/multiple-independent-questions-batch-into-one-request-or-split-into-many-an-analysis-of-llm-concurrent-processing/69f69488bf43b2821c73cbc3"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Multiple Independent Questions: Batch Into One Request or Split Into Many? — An Analysis of LLM Concurrent Processing](https://ai-is-coming.hashnode.dev/multiple-independent-questions-batch-into-one-request-or-split-into-many-an-analysis-of-llm-concurrent-processing?utm_source=hashnode&utm_medium=feed)

When you have 5 unrelated questions, should you pack them into one message to the LLM, or send 5 requests simultaneously? Which is faster? The Short Answer Splitting into multiple independent parallel requests is almost always faster. This isn't a g...

May 3 · 6 min read · ai-is-coming.hashnode.dev  
Read the article

-   [#parallel-requests](https://hashnode.com/tag/parallel-requests)
-   [#gpu-inference-optimization](https://hashnode.com/tag/gpu-inference-optimization)
-   [#autoregressive-generation](https://hashnode.com/tag/autoregressive-generation)
-   [#continuous-batching](https://hashnode.com/tag/continuous-batching)
-   [#llm-inference](https://hashnode.com/tag/llm-inference)

## Written by

[eyanpen](https://hashnode.com/@eyanpen)

@eyanpen · Shanghai, China

  
[View profile](https://hashnode.com/@eyanpen)

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
