Layer Normalization for Sequence Data
Initialization, Normalization & Regularization DS practice problem on Onlearn.
Difficulty: medium.
Topics: Understanding Implement Layer Normalization for Sequence Data, Feature-wise Centering, Learnable Affine Transformation, Running Variance Estimation, Epsilon Smoothing, Broadcasting Semantics, Deep Learning Foundations, Numerical Linear Algebra, Statistical Learning Theory, Computational Optimization, Sequence Modeling, Normalization Techniques, Tensor Manipulation, Parameter Initialization, Activation Function Dynamics, Gradient Flow Analysis.
Implement a function to perform Layer Normalization on an input tensor. Given a 3D array representing batch size, sequence length, and feature dimensions, normalize the data across the feature dimension for each sequence, then apply scaling and shifting parameters.