---
title: "Discussion on \"A/B Testing at Scale: Power, Sequential Testing, and Practical Pitfalls\" | Hashnode"
description: "Discussion on \"A/B Testing at Scale: Power, Sequential Testing, and Practical Pitfalls\". What peeking, low power and too many metrics do to your error rates, measured with 20,000 simulated experiments."
url: "https://hashnode.com/posts/ab-testing-at-scale/6addf0bb8133d70a819352d1"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [A/B Testing at Scale: Power, Sequential Testing, and Practical Pitfalls](https://ruchita-tech-journal.hashnode.dev/ab-testing-at-scale?utm_source=hashnode&utm_medium=feed)

What peeking, low power and too many metrics do to your error rates, measured with 20,000 simulated experiments.

Oct 25 · 23 min read · ruchita-tech-journal.hashnode.dev  
Read the article

-   [#data-science](https://hashnode.com/tag/data-science)
-   [#statistics](https://hashnode.com/tag/statistics)
-   [#ab-testing](https://hashnode.com/tag/ab-testing)
-   [#python](https://hashnode.com/tag/python)
-   [#machine-learning](https://hashnode.com/tag/machine-learning)

## Written by

[Ruchita Daga](https://hashnode.com/@ruchitadaga09)

@ruchitadaga09 · Pune, India

  
[View profile](https://hashnode.com/@ruchitadaga09)

## Responses

Markdown supported · ⌘↵ to post

No responses yet.