SKShakib Khaninsakibkhan.hashnode.dev·Apr 5, 2021 · 5 min readProfound of Cross-EntropyToday I'm going to discuss cross-entropy and Binary cross-entropy. Before that, we need to understand the basics of the Sigmoid and Softmax function. Let's dive in. Sigmoid Function It squashes a vector in the range (0, 1). It is applied independent...00
SKShakib Khaninsakibkhan.hashnode.dev·Mar 22, 2021 · 5 min readDeep Dive into Entropy, Cross-Entropy, KL-divergenceIn the machine learning field, we heard the term cross-entropy a lot, but what the heck is this, and what this function does. So today we're going to discuss what is entropy, cross-entropy, KL-divergence? Entropy from Physics Perspective The idea o...00
