Đại học Kinh tế Quốc dân – National Economics UniversityMICRO4ASIA
🏆 Arena
Sign inSign up
MICRO4ASIAThe six micro-credentials

Courses are delivered on the Limio learning platform. Limio

← Mathematical Foundations for Data Science

You are viewing a public preview

Sign in to save your progress, do assignments, join discussions and get feedback.

Sign in
Part III — Probability and Statistics

Topic 12 · Expectation, Variance and Moments

Print / Save as PDF
Lecture video — Topic 12: Expectation, Variance and Moments

Expectation as a probability-weighted average, variance as spread around the mean, and how a linear transformation changes both.

Flashcards · Expectation, Variance and Moments

9 words
WordMeaningExample
  • Expectation

    The probability-weighted average of the values: E[g(X)] = Σ g(x)p(x), or ∫ g(x)f(x)dx.

    Two tosses: E(X) = 0(1/4) + 1(1/2) + 2(1/4) = 1.

  • Linearity of expectation

    E(aX + bY + c) = aE(X) + bE(Y) + c; no independence needed.

  • Variance

    V(X) = E[(X − μ)²] = E(X²) − [E(X)]²; the standard deviation is its square root.

    V(X) = 3/2 − 1² = 1/2.

  • Scaling rule

    E(aX + b) = aE(X) + b and V(aX + b) = a²V(X); the shift b does not change the variance.

    V(3X + 2) = 9V(X).

  • Raw moment

    μ′ᵣ = E(Xʳ); in particular μ′₂ = σ² + μ².

    Poisson(4): E(X²) = 4 + 16 = 20.

  • Bernoulli(p)

    Mean p and variance p(1 − p), because X² = X.

    p = 0.20: variance 0.16, standard deviation 0.40.

  • Binomial and Poisson

    Binomial(n, p): mean np, variance np(1 − p). Poisson(λ): mean = variance = λ.

  • Uniform and exponential

    Uniform(a, b): mean (a + b)/2, variance (b − a)²/12. Exponential with scale β: mean β, variance β².

  • Mean squared distance

    E[(X − c)²] = V(X) + [E(X) − c]², smallest at c = E(X).

    Binomial(8, 0.5), c = 3: 2 + 1 = 3.

Practice in Python

Work through Section 3 of Lab 3 (Probability and Statistics, MFDS_Lab3_Probability_Statistics.ipynb), attached to the Part III materials lesson at the start of this part.