Đại học Kinh tế Quốc dân – National Economics UniversityMICRO4ASIA
🏆 Arena
Sign inSign up
MICRO4ASIAThe six micro-credentials

Courses are delivered on the Limio learning platform. Limio

← Mathematical Foundations for Data Science

You are viewing a public preview

Sign in to save your progress, do assignments, join discussions and get feedback.

Sign in
Part III — Probability and Statistics

Topic 13 · Joint Distributions and Dependence

Print / Save as PDF
Lecture video — Topic 13: Joint Distributions and Dependence

Joint, marginal and conditional distributions through a website sign-up example, joint densities, covariance and correlation, and conditional expectation.

Flashcards · Joint Distributions and Dependence

9 words
WordMeaningExample
  • Joint mass function

    p_{X,Y}(x, y) = P(X = x, Y = y); nonnegative, and all values sum to 1.

  • Marginal distribution

    Sum (or integrate) the joint over the other variable: p_X(x) = Σ_y p_{X,Y}(x, y).

    Action rate: 0.05 + 0.15 = 0.20.

  • Conditional distribution

    p(x | y) = p(x, y) / p_Y(y); for densities f(x | y) = f(x, y) / f_Y(y).

    P(X = 1 | Y = 1) = 0.15 / 0.50 = 0.30.

  • Independence of variables

    The joint factorizes for every pair: p(x, y) = p_X(x) p_Y(y), or f(x, y) = f_X(x) f_Y(y).

  • Covariance

    Cov(X, Y) = E[(X − μ_X)(Y − μ_Y)] = E(XY) − E(X)E(Y); positive means they tend to move together.

    0.15 − 0.20(0.50) = 0.05.

  • Correlation

    ρ = Cov(X, Y) / (σ_X σ_Y), between −1 and 1; it measures linear association only.

    0.05 / (0.4 × 0.5) = 0.25.

  • Uncorrelated versus independent

    Independent ⇒ Cov = 0, but Cov = 0 does not imply independence.

    X uniform on {−2, −1, 1, 2} and Y = |X|.

  • Variance of a combination

    V(aX + bY) = a²V(X) + b²V(Y) + 2ab Cov(X, Y).

    V(2X − Y) = 4V(X) + V(Y) − 4Cov(X, Y).

  • Conditional expectation

    E(X | Y = y) is the mean of X under the conditional distribution; E(X | Y) is a random variable and E[E(X | Y)] = E(X).

    0.8 + 0.4Y in the three-valued example.

Practice in Python

Work through Section 4 of Lab 3 (Probability and Statistics, MFDS_Lab3_Probability_Statistics.ipynb), attached to the Part III materials lesson at the start of this part.