---
title: "Discussion on \"A Concise Introduction to the ReLU Function\" | Hashnode"
description: "Discussion on \"A Concise Introduction to the ReLU Function\". Introduction\nThe rectified linear unit function, ReLU, is one of the three most commonly used activation functions used in deep learning, including the sigmoid (sig) and hyperbolic tangent (tan) functions. It is a type of ramp function that is somewh..."
url: "https://hashnode.com/posts/a-concise-introduction-to-the-relu-function/61450421e1f56817e3604c75"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [A Concise Introduction to the ReLU Function](https://codesandcoffee.hashnode.dev/a-concise-introduction-to-the-relu-function?utm_source=hashnode&utm_medium=feed)

Introduction The rectified linear unit function, ReLU, is one of the three most commonly used activation functions used in deep learning, including the sigmoid (sig) and hyperbolic tangent (tan) functions. It is a type of ramp function that is somewh...

Sep 17, 2021 · 5 min read · codesandcoffee.hashnode.dev  
Updated Nov 4, 2021  
Read the article

-   [#deep-learning](https://hashnode.com/tag/deep-learning)
-   [#machine-learning](https://hashnode.com/tag/machine-learning)
-   [#python](https://hashnode.com/tag/python)
-   [#tensorflow](https://hashnode.com/tag/tensorflow)
-   [#mathematics](https://hashnode.com/tag/mathematics)

## Written by

[Oluwatobi Adefami](https://hashnode.com/@codesandcoffee)

@codesandcoffee · Lagos, Nigeria

  
[View profile](https://hashnode.com/@codesandcoffee)

machine learning research

Hi, I'm Oluwatobi and I'm a machine learning researcher. I write about Machine learning (obviously), programming techniques, and any topic in relation to the previously stated areas. I'm a perfectionist and I try to finesse every task I take on but I've come to realise it's quite unproductive, so I've learned to deliver a minimum viable product in situations where I can't exhibit perfectionism. Although I work with Python extensively, I love Julia lang and hope to use it primarily someday.

## Responses 1

Markdown supported · ⌘↵ to post

[Soumendra kumar sahoo](https://hashnode.com/@soumendrak)

[Sep 18, 2021](https://hashnode.com/posts/a-concise-introduction-to-the-relu-function/61450421e1f56817e3604c75/comment/61455e09a2b54e17a52c1244)

Nice article with code.

[Oluwatobi Adefami](https://hashnode.com/@codesandcoffee)

[Sep 18, 2021](https://hashnode.com/posts/a-concise-introduction-to-the-relu-function/61450421e1f56817e3604c75/comment/61455e09a2b54e17a52c1244#reply-6145b1a9a2b54e17a52c2005)

Glad you enjoyed it!
