Deep Dive into Entropy, Cross-Entropy, KL-divergence

In the machine learning field, we heard the term cross-entropy a lot, but what the heck is this, and what this function does. So today we're going to discuss what is entropy, cross-entropy, KL-divergence? Entropy from Physics Perspective The idea o...