---
title: "Discussion on \"How Sorting Your Prompts Speeds Up a Mixture-of-Experts Batch Job\" | Hashnode"
description: "Discussion on \"How Sorting Your Prompts Speeds Up a Mixture-of-Experts Batch Job\". Similar prompts pick the same experts, so a sorted batch reads fewer weights per step. Hugging Face measured 5–17% more throughput on unchanged vLLM."
url: "https://hashnode.com/posts/how-sorting-your-prompts-speeds-up-a-mixture-of-experts-batch-job/6ad967b016d0cad75ff96324"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [How Sorting Your Prompts Speeds Up a Mixture-of-Experts Batch Job](https://theaicommit.hashnode.dev/how-sorting-your-prompts-speeds-up-a-mixture-of-experts-batch-job?utm_source=hashnode&utm_medium=feed)

Similar prompts pick the same experts, so a sorted batch reads fewer weights per step. Hugging Face measured 5–17% more throughput on unchanged vLLM.

Oct 22 · 9 min read · theaicommit.hashnode.dev  
Read the article

-   [#llm-engineering-ai-infrastructure-python-gpu-optimization-performance-engineering-machine-learning-systems-devops-artificial-intelligence-software-engineering-programming-cloud-computing-deep-learning](https://hashnode.com/tag/llm-engineering-ai-infrastructure-python-gpu-optimization-performance-engineering-machine-learning-systems-devops-artificial-intelligence-software-engineering-programming-cloud-computing-deep-learning)

## Written by

[Theaicommit](https://hashnode.com/@theaicommit)

@theaicommit

  
[View profile](https://hashnode.com/@theaicommit)

Daily AI labs for engineers

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
