KL Divergence Between Two Normal Distributions
Probability Theory DS practice problem on Onlearn.
Difficulty: easy.
Topics: Understanding KL Divergence Between Two Normal Distributions, Kullback-Leibler Divergence, Gaussian Distribution, Variance-Covariance Matrix, Entropy, Maximum Likelihood Estimation, Probability & Statistics, Information Theory, Calculus, Linear Algebra, Bayesian Inference, Probability Distributions, Divergence Measures, Multivariate Analysis, Logarithmic Identities, Statistical Moments.
Task: Implement KL Divergence Between Two Normal Distributions Your task is to compute the Kullback Leibler (KL) divergence between two normal distributions. KL divergence measures how one probability distribution differs from a second, reference probability distribution. Write a function kl divergence normal(mu p, sigma p, mu q, sigma q) that calculates the KL divergence between two normal distributions. The function should return the KL divergence as a floating point number.