mathdatech/Python
1
0
Fork 0
mirror of https://github.com/TheAlgorithms/Python.git synced 2025-02-25 18:38:39 +00:00
Code Issues Packages Projects Releases Wiki Activity

Added Leaky ReLU activation function

Browse Source
This commit is contained in:
kausthub-kannan 2023-08-14 23:23:13 +05:30
parent 771ca1d799
commit 9b80d1f943
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
neural_network/activation_functions/leaky_rectified_linear_unit.py
View File

@ -20,10 +20,10 @@ def leaky_rectified_linear_unit(vector: np.ndarray, alpha: float) -> np.ndarray:
"""
Implements the LeakyReLU activation function.
Parameters:
vector: the array containing input of elu activation
vector: the array containing input of leakyReLu activation
alpha: hyperparameter
return:
leaky_relu (np.array): The input numpy array after applying leaky-relu.
leaky_relu (np.array): The input numpy array after applying leakyReLu.
Formula : f(x) = x if x > 0 else f(x) = alpha * x