---
title: "Comment by Enrique Cardoza on \"Lawson : A Tool for Lawyers to Understand Court Cases in Seconds\" | Hashnode"
description: "API limits are most of the problems when working with LLMs service providers. Did you try load balancing?"
url: "https://hashnode.com/posts/lawson/669e7c49a718f8e38ea07c8e/comment/66a62eb8dce81015ff90e8df"
---

[Discussion](https://hashnode.com/posts/lawson/669e7c49a718f8e38ea07c8e)

Comment [Lawson : A Tool for Lawyers to Understand Court Cases in Seconds](https://hashnode.com/posts/lawson/669e7c49a718f8e38ea07c8e)

[Enrique Cardoza](https://hashnode.com/@thatCardoza)

[Jul 28, 2024](https://hashnode.com/posts/lawson/669e7c49a718f8e38ea07c8e/comment/66a62eb8dce81015ff90e8df)

API limits are most of the problems when working with LLMs service providers.

Did you try load balancing?

[FaYMan2](https://hashnode.com/@FaTGuY1)

[Jul 28, 2024](https://hashnode.com/posts/lawson/669e7c49a718f8e38ea07c8e/comment/66a62eb8dce81015ff90e8df#reply-66a664fda7b83de408da67cb)

Yes, we did use load balancing, in our case the biggest problems we faced were the context length of LLM and Rate Limits. We solved the problem by having multiple keys and equally distributing the queries between them using multithreading, as for the context length we just shifted to the K-means summarization technique for long documents.

[Enrique Cardoza](https://hashnode.com/@thatCardoza)

[Jul 28, 2024](https://hashnode.com/posts/lawson/669e7c49a718f8e38ea07c8e/comment/66a62eb8dce81015ff90e8df#reply-66a6ae37a0ab5192d309bfb5)

Multithreading and multiple keys is a good strategy.

This is a great work! [FaYMan2](https://hashnode.com/@FaTGuY1)

[FaYMan2](https://hashnode.com/@FaTGuY1)

[Jul 29, 2024](https://hashnode.com/posts/lawson/669e7c49a718f8e38ea07c8e/comment/66a62eb8dce81015ff90e8df#reply-66a72358a22f515987d3d071)

[Enrique Cardoza](https://hashnode.com/@thatCardoza) Thanks for the compliment , if you like our work feel free sharing . If you want to read the nitty-gritty details all the code is open source and you can visit and read it .
