Back to the lessonPreparing the printout…

Mathematical Foundations for Data Science · Part III — Probability and Statistics

Topic 12 · Expectation, Variance and Moments

[video] Lecture video — Topic 12: Expectation, Variance and Moments — /api/lesson-media/videos/4d3653ff-a3ca-4f63-bf8e-bb93c553e599-1794840941171-65cf188553b9a821.mp4

Flashcards · Expectation, Variance and Moments

Expectation — The probability-weighted average of the values: E[g(X)] = Σ g(x)p(x), or ∫ g(x)f(x)dx.

Two tosses: E(X) = 0(1/4) + 1(1/2) + 2(1/4) = 1.

Linearity of expectation — E(aX + bY + c) = aE(X) + bE(Y) + c; no independence needed.

Variance — V(X) = E[(X − μ)²] = E(X²) − [E(X)]²; the standard deviation is its square root.

V(X) = 3/2 − 1² = 1/2.

Scaling rule — E(aX + b) = aE(X) + b and V(aX + b) = a²V(X); the shift b does not change the variance.

V(3X + 2) = 9V(X).

Raw moment — μ′ᵣ = E(Xʳ); in particular μ′₂ = σ² + μ².

Poisson(4): E(X²) = 4 + 16 = 20.

Bernoulli(p) — Mean p and variance p(1 − p), because X² = X.

p = 0.20: variance 0.16, standard deviation 0.40.

Binomial and Poisson — Binomial(n, p): mean np, variance np(1 − p). Poisson(λ): mean = variance = λ.

Uniform and exponential — Uniform(a, b): mean (a + b)/2, variance (b − a)²/12. Exponential with scale β: mean β, variance β².

Mean squared distance — E[(X − c)²] = V(X) + [E(X) − c]², smallest at c = E(X).

Binomial(8, 0.5), c = 3: 2 + 1 = 3.

[markdown] content available only on the platform

Mathematical Foundations for Data Science · Topic 12 · Expectation, Variance and Moments · printed on November 20, 2026