---
title: "Discussion on \"I Built an AI PR Reviewer for Azure DevOps So My Team Could Stop Pretending \"LGTM\" Means Safe\" | Hashnode"
description: "Discussion on \"I Built an AI PR Reviewer for Azure DevOps So My Team Could Stop Pretending \"LGTM\" Means Safe\". Subtle bugs move faster in AI-generated PRs, so this pipeline adds a practical last guardrail before merge."
url: "https://hashnode.com/posts/i-built-an-ai-pr-reviewer-for-azure-devops-so-my-team-could-stop-pretending-lgtm-means-safe/6a2e849d722d75ec30a65421"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [I Built an AI PR Reviewer for Azure DevOps So My Team Could Stop Pretending "LGTM" Means Safe](https://jinyongwu.hashnode.dev/i-built-an-ai-pr-reviewer-for-azure-devops-so-my-team-could-stop-pretending-lgtm-means-safe?utm_source=hashnode&utm_medium=feed)

Subtle bugs move faster in AI-generated PRs, so this pipeline adds a practical last guardrail before merge.

Jun 14 · 6 min read · jinyongwu.hashnode.dev  
Updated Jun 22  
Read the article

-   [#llm](https://hashnode.com/tag/llm)
-   [#agentic-ai](https://hashnode.com/tag/agentic-ai)
-   [#agents](https://hashnode.com/tag/agents)
-   [#pr-review](https://hashnode.com/tag/pr-review)
-   [#review](https://hashnode.com/tag/review)
-   [#foundry](https://hashnode.com/tag/foundry)

## Written by

[JinYong Wu](https://hashnode.com/@jinyongwu)

@jinyongwu · Asker, Oslo

  
[View profile](https://hashnode.com/@jinyongwu)

## Responses 1

Markdown supported · ⌘↵ to post

[prpulse](https://hashnode.com/@prpulse-dev)

[Jun 28](https://hashnode.com/posts/i-built-an-ai-pr-reviewer-for-azure-devops-so-my-team-could-stop-pretending-lgtm-means-safe/6a2e849d722d75ec30a65421/comment/6a4176d48dfab1911f71ad14)

This is one of the most honest takes on AI-generated PRs I've read. The "AI can produce plausible but wrong code at scale" point is underappreciated — the danger isn't that AI code is obviously broken, it's that it _looks_ clean so reviewers lower their guard. You've described exactly what's happening on teams right now.

The dedup logic point is critical and something most people building these tools get wrong. A reviewer that posts the same comment 3 times trains engineers to ignore everything it says. The credibility model matters as much as the accuracy model.

Your layered defense framing (author intent → AI first pass → human final decision) is how teams should be thinking about this. The problem we keep seeing is that as generation speed increases, teams skip layer 2 entirely and go straight to rubber-stamping at layer 3.

Curious how your team handled the signal-to-noise calibration over time — specifically the severity thresholds. Getting engineers to trust "high" actually means high seems to be the hardest adoption problem in practice.
