Dec 24, 2025 Β· 22 min read Β· Hello Techiesπ! Iβm Samiksha, Hope you all are doing amazing stuff. Iβm back with Another Super trendy shift in building Agentic AI products i.e Eval first Thinking. Everyone nowadays talking about LLM-as-Judge for evaluating the Stochastic Agents o...
Join discussion
Nov 9, 2025 Β· 10 min read Β· If youβve been following the world of AI development, you mightβve heard the phrase βLLM-as-Judge.βIt sounds dramatic, like some sci-fi overlord where one AI passes judgment on another. But itβs actually one of the most important evolutions in evalua...
Join discussion
Jul 24, 2025 Β· 14 min read Β· Introduction I have been tinkering with LLMs at work and outside now for quite a while and one of the most pressing issues compared to traditional machine learning is the unsolved problem of how to evaluate them. Evaluating LLM outputs is exponential...
SSebastian commented
Jun 23, 2025 Β· 6 min read Β· Image Source: LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods Fundamental questions to think about: (source: Limitations of the LLM-as-a-Judge Approach for Evaluating LLM Outputs in Expert Knowledge Tasks | Proceedings of the 3...
Join discussion
Mar 15, 2025 Β· 8 min read Β· AI μ νμμ νκ° μμ€ν μ μ€μμ± AI μ ν, νΉν λν μΈμ΄ λͺ¨λΈ(Large Language Model, LLM) κΈ°λ° μ νμ μ±κ³΅μ μν΄μλ 체κ³μ μ΄κ³ κ°λ ₯ν νκ° μμ€ν μ΄ νμμ μ λλ€. κ·Έ μ΄μ λ λ€μκ³Ό κ°μ΅λλ€. 1. μ§μμ μΈ μ±λ₯ κ°μ : νκ° μμ€ν μ AI μ νμ μ±λ₯μ μ§μμ μΌλ‘ λͺ¨λν°λ§νκ³ κ°μ ν μ μκ² ν©λλ€. λ€μν μμ€μ νκ° μ²΄κ³λ₯Ό ν΅ν΄ μ νμ μ½μ μ νμ νκ³ κ°μ ν μ μμ΅λλ€. 2. λΉ λ₯Έ λ°λ³΅ κ°λ₯: νκ° μμ€ν μ ...
Join discussion
Mar 15, 2025 Β· 10 min read Β· Importance of Evaluation Systems in AI Products Virtuous cycle of AI product improvement To ensure the success of AI products, especially those based on Large Language Models (LLMs), a systematic and robust evaluation system is essential. The reason...
Join discussion
Feb 13, 2025 Β· 7 min read Β· Want the tl;dr;? Jump to the bottom for some tables the suggest which style of judgements you need! Unveiling the Judging Spectrum: From Perfection to Bias There are various types of Judgements, and recently, I've been contemplating the emergence of...
Join discussion
