---
title: "Discussion on \"Deep Dive into Entropy, Cross-Entropy, KL-divergence\" | Hashnode"
description: "Discussion on \"Deep Dive into Entropy, Cross-Entropy, KL-divergence\". In the machine learning field, we heard the term cross-entropy a lot, but what the heck is this, and what this function does.\nSo today we're going to discuss what is entropy, cross-entropy, KL-divergence?\n\nEntropy from Physics Perspective \nThe idea o..."
url: "https://hashnode.com/posts/deep-dive-into-entropy-cross-entropy-kl-divergence/6058dcb05771a2129446a647"
---

[Feed](https://hashnode.com/feed) /

Discussion

[Shakib Khan](https://hashnode.com/@shakibkhan)

AI Enthusiatic

Mar 22, 2021

# [Deep Dive into Entropy, Cross-Entropy, KL-divergence](https://sakibkhan.hashnode.dev/deep-dive-into-entropy-cross-entropy-kl-divergence?utm_source=hashnode&utm_medium=feed)

In the machine learning field, we heard the term cross-entropy a lot, but what the heck is this, and what this function does. So today we're going to discuss what is entropy, cross-entropy, KL-divergence? Entropy from Physics Perspective The idea o...

sakibkhan.hashnode.dev 5 min read

[#ai](https://hashnode.com/tag/ai) [#machine-learning](https://hashnode.com/tag/machine-learning) [#deep-learning](https://hashnode.com/tag/deep-learning)

## Responses

Markdown supported · ⌘↵ to post

No responses yet.