The SELU Activation Function
Neural Units & Activations DS practice problem on Onlearn.
Difficulty: easy.
Topics: Understanding Implement the SELU Activation Function, Self-Normalizing Neural Networks, Fixed Point Attractors, Numerical Stability, Alpha Dropout, Exponential Linear Units, Deep Learning Foundations, Numerical Analysis, Statistical Learning Theory, Computational Optimization, Neural Network Architecture, Activation Function Design, Weight Initialization Strategies, Internal Covariate Shift, Floating Point Arithmetic, Gradient Flow Dynamics.
Implement the SELU (Scaled Exponential Linear Unit) activation function, a self normalizing variant of ELU. Your task is to compute the SELU value for a given input while ensuring numerical stability.