sakibkhan.hashnode.devProfound of Cross-EntropyToday I'm going to discuss cross-entropy and Binary cross-entropy. Before that, we need to understand the basics of the Sigmoid and Softmax function. Let's dive in. Sigmoid Function It squashes a vector in the range (0, 1). It is applied independent...Apr 5, 2021·5 min read
sakibkhan.hashnode.devDeep Dive into Entropy, Cross-Entropy, KL-divergenceIn the machine learning field, we heard the term cross-entropy a lot, but what the heck is this, and what this function does. So today we're going to discuss what is entropy, cross-entropy, KL-divergence? Entropy from Physics Perspective The idea o...Mar 22, 2021·5 min read
