---
title: "Discussion on \"Build a production-grade RAG or similarity search using Qdrant and Langchain\" | Hashnode"
description: "Discussion on \"Build a production-grade RAG or similarity search using Qdrant and Langchain\". Build a more robust production-grade RAG system or similarity search using Qdrant and Langchain."
url: "https://hashnode.com/posts/build-a-production-grade-rag-or-similarity-search-using-qdrant-and-langchain/661f6f7888fddf8ffc42874b"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Build a production-grade RAG or similarity search using Qdrant and Langchain](https://kevincoder.co.za/build-a-production-grade-rag-or-similarity-search-using-qdrant-and-langchain?utm_source=hashnode&utm_medium=feed)

Build a more robust production-grade RAG system or similarity search using Qdrant and Langchain.

Apr 17, 2024 · 6 min read · kevincoder.co.za  
Updated Mar 8, 2025  
Read the article

-   [#qdrant](https://hashnode.com/tag/qdrant)
-   [#machine-learning](https://hashnode.com/tag/machine-learning)
-   [#rag](https://hashnode.com/tag/rag)
-   [#openai](https://hashnode.com/tag/openai)
-   [#langchain](https://hashnode.com/tag/langchain)
-   [#python](https://hashnode.com/tag/python)

## Written by

[Kevin Naidoo](https://hashnode.com/@kwnaidoo)

@kwnaidoo · Durban, South Africa

  
[View profile](https://hashnode.com/@kwnaidoo)

Passionate & experienced tech enthusiast

On kevincoder.co.za, I write about my journey as a developer working across Django, Go, and everything in between, from large-scale systems to small, useful tools. Programming has been my passion for about 2 decades now, and I'm still loving it, so I experiment a lot and sometimes write about it.

## Responses 1

Markdown supported · ⌘↵ to post

[Elon Musk](https://hashnode.com/@Elon817)

[May 29, 2024](https://hashnode.com/posts/build-a-production-grade-rag-or-similarity-search-using-qdrant-and-langchain/661f6f7888fddf8ffc42874b/comment/6656dcc8a679c7782ee4a286)

Dear [Kevin Naidoo](https://hashnode.com/@kwnaidoo)

I am Elon, and thank you for the informative article on RAG conversational AI. I'm still curious, however, about the choice of Qdrant over Faiss for production-grade deployments.

As mentioned previously, I'm developing a chatbot for a public academic website. I'm facing a few challenges:

1.  Handling High Call Volume: I need to manage multiple chatbot interactions within a short timeframe. To address this, I'm considering the asynchronous Qdrant client. However, I'm unsure about the optimal call rate per minute for the chatbot when using a large model like GPT-3.5-turbo.
    
2.  Balancing Updates and Queries: The chatbot's knowledge base needs to stay up-to-date, requiring daily backend updates. I'm unsure how to handle both updates and queries simultaneously. Should chatbot calls be blocked during database updates?
    

Given my limited experience with chatbot development, I haven't found clear answers to these questions. Additionally, I'd appreciate insights on the potential drawbacks of using Faiss for these concerns.

Thank you for your time and assistance.

Best regards,

[Kevin Naidoo](https://hashnode.com/@kwnaidoo)

[May 30, 2024](https://hashnode.com/posts/build-a-production-grade-rag-or-similarity-search-using-qdrant-and-langchain/661f6f7888fddf8ffc42874b/comment/6656dcc8a679c7782ee4a286#reply-66581b218b8293d753ddd9de)

Hi [Elon Musk](https://hashnode.com/@Elon817), Faiss is in memory, it's efficient but for large applications, you would want to use replication to split up read/writes and distribute traffic better.

This is why Qdrant is a better fit, furthermore, when you restart your application instance FAISS loses its memory, you can write the buffer to disk and reindex on the next startup but as you can imagine this is not very efficient.

You can learn more about how to distribute Qdrant over many servers here: [qdrant.tech/documentation/guides/distributed\_depl…](https://qdrant.tech/documentation/guides/distributed_deployment/)

Qdrant can handle multiple concurrent writes just fine like any other DB, so updating your RAG data in real-time should not be a problem, as mentioned above you can always split the traffic with distributed deployments.

As for multiple calls to GPT-3.5-Turbo, since the heavy lifting is done on the OpenAI side, you should not be using that much of GPU resources if any, so the only limitation would be your web server or application server and the number of requests it can handle per second.

Try: [github.com/tsenart/vegeta](https://github.com/tsenart/vegeta) to simulate high traffic and see how your machines respond.

All the best, hope this helps.
