Why Accuracy Fails in Real-World ML Systems

I used to trust accuracy far more than I should have. The first time I trained a classifier that crossed 95%, I remember the quiet satisfaction. The curve looked clean. The confusion matrix was almost boring. I took a screenshot. Sent it to a friend....