Group Normalization
Initialization, Normalization & Regularization DS practice problem on Onlearn.
Difficulty: medium.
Topics: Understanding Implement Group Normalization, Group Normalization, Channel Partitioning, Affine Transformation, Running Statistics, Variance Stabilization, Deep Learning Foundations, Numerical Analysis, Statistical Learning, Computational Geometry, Signal Processing, Normalization Techniques, Tensor Operations, Neural Network Architectures, Parameter Optimization, Feature Representation.
Write a Python function to perform Group Normalization on a 4D input tensor with shape (B, C, H, W). The function should normalize over smaller groups of channels, then apply a learned scale (gamma) and shift (beta).