6d ago 路 17 min read 路 TLDR: 馃搹 Traditional ML metrics (accuracy, F1) fail for LLMs because there's no single "correct" answer. RAGAS measures RAG pipeline quality with faithfulness, answer relevance, and context precision. DeepEval provides unit-test-style LLM evaluation....
EAli commentedNov 16, 2025 路 14 min read 路 You want to build an AI application. Something useful. Something your users can rely on. But here's the problem: How do you know it's actually good? You can build an app that generates summaries, answers questions, or writes emails. It works. Your te...
Join discussion
Nov 9, 2025 路 10 min read 路 If you鈥檝e been following the world of AI development, you might鈥檝e heard the phrase 鈥淟LM-as-Judge.鈥滻t sounds dramatic, like some sci-fi overlord where one AI passes judgment on another. But it鈥檚 actually one of the most important evolutions in evalua...
Join discussion
Oct 26, 2025 路 5 min read 路 A few months ago, as I was exploring machine learning while working on a project, one of my models kept behaving in a weird way. I had built a classifier to detect cats in images. During training, accuracy was awesome, near 99%. But in production, it...
Join discussion
Oct 2, 2025 路 6 min read 路 A few months back, I had the chance to present a talk at an AI meetup. My topic was Generative AI Agents, and to make the session more practical, I prepared a small hands-on demo using CrewAI and Ragas. The demo was simple but effective:馃憠 Generate S...
Join discussion
Jun 3, 2025 路 6 min read 路 馃 What is Ragas? Ragas (Retrieval-Augmented Generation Assessment) is an open-source Python framework to automatically evaluate the performance of RAG pipelines. RAG systems retrieve documents from a knowledge base and use them to generate answers. ...
Join discussion
Jun 3, 2025 路 3 min read 路 As Large Language Models (LLMs) become powerful tools for question answering and summarization, one major challenge still remains: retrieving up-to-date and domain-specific information. This is where Retrieval-Augmented Generation (RAG) systems come ...
Join discussion
Dec 10, 2024 路 9 min read 路 馃挕 DISCLAIMER: This post is intended for educational purposes only. Actual results may vary depending on your dataset, environment, and configurations. Retrieval Augmented Generation (RAG) solutions combine Large Language Models (LLMs) with externa...
Join discussion
Nov 13, 2024 路 2 min read 路 pip install -U llama-index llama-index-core pip install langfuse datasets ragas llama_index python-dotenv openai --upgrade pip install ragas TRY 2 pip install pyarrow==16.1.0 pip install nltk pip install ragas pip install boto3 In credentials file h...
Join discussionJul 24, 2024 路 31 min read 路 Retrieval-Augmented Generation (RAG) applications are becoming increasingly popular as large language models (LLMs) improve. These applications combine retrieval and generation to provide accurate, contextually relevant responses. Validating and eval...
Join discussion
