---
title: "Discussion on \"The Kaiming initialization  and Batch Normalization in Neural Networks\" | Hashnode"
description: "Discussion on \"The Kaiming initialization  and Batch Normalization in Neural Networks\". In my last blog post, we discussed and solved through code, how to initialize the hidden layer in neural network properly, to get rid of dead neurons. We came up with some magic numbers, randomly, as well as, by looking at the mathematics of tanh act..."
url: "https://hashnode.com/posts/the-kaiming-initialization-and-batch-normalization-in-neural-networks/677d1bfc7a3b880ca197419f"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [The Kaiming initialization and Batch Normalization in Neural Networks](https://aabidkarim.hashnode.dev/the-kaiming-initialization-and-batch-normalization-in-neural-networks?utm_source=hashnode&utm_medium=feed)

In my last blog post, we discussed and solved through code, how to initialize the hidden layer in neural network properly, to get rid of dead neurons. We came up with some magic numbers, randomly, as well as, by looking at the mathematics of tanh act...

Jan 7, 2025 · 17 min read · aabidkarim.hashnode.dev  
Read the article

-   [#the-kaiming-initialization](https://hashnode.com/tag/the-kaiming-initialization)
-   [#dead-neurons](https://hashnode.com/tag/dead-neurons)
-   [#neural-networks](https://hashnode.com/tag/neural-networks)
-   [#batch-normalization](https://hashnode.com/tag/batch-normalization)
-   [#optimization](https://hashnode.com/tag/optimization)

## Written by

[Abed K](https://hashnode.com/@AabidKarim)

@AabidKarim · Melbourne Australia

  
[View profile](https://hashnode.com/@AabidKarim)

AI/ML and Data Science

Welcome to my blog, where I share my journey through the fascinating world of Artificial Intelligence and Machine Learning. I critically analyze research papers to break down complex ideas and uncover insights. Alongside, I document my hands-on experiences in creating neural networks from scratch, explaining every small detail and tackling coding challenges step by step. Whether you're here to explore theory or dive into practical implementation, this blog is for you!

## Responses

Markdown supported · ⌘↵ to post

No responses yet.