Back to the lessonPreparing the printout…

Mathematical Foundations for Data Science · Part III — Probability and Statistics

Topic 14 · Sampling Distributions and the Central Limit Theorem

[video] Lecture video — Topic 14: Sampling Distributions and the Central Limit Theorem — /api/lesson-media/videos/4d3653ff-a3ca-4f63-bf8e-bb93c553e599-1794840943563-84eb6908e2fc2e32.mp4

Flashcards · Sampling Distributions and the CLT

Statistic — A function of the sample that does not involve unknown parameters; it is random before the data are observed.

The sample mean X̄.

Sampling distribution — The distribution of a statistic over repeated samples of the same size from the same model.

iid sample — X1, …, Xn independent and drawn from the same distribution.

Mean of the sample mean — E(X̄) = μ for any iid sample with finite mean.

Variance of the sample mean — V(X̄) = σ²/n for an iid sample with variance σ².

σ² = 100, n = 25: variance 4.

Standard error — SE(X̄) = σ/√n, the standard deviation of the sampling distribution; quadrupling n halves it.

σ = 12, n = 36: SE = 2.

Central limit theorem — (X̄ − μ)/(σ/√n) converges in distribution to N(0, 1); the observations need not be normal.

n = 25 exponential: P(X̄ ≤ 12) ≈ 0.8413.

Normal population — If the observations are N(μ, σ²), then X̄ ~ N(μ, σ²/n) exactly for every n.

Law of large numbers — X̄ converges to μ in probability: the mean concentrates; the CLT describes the shape of the scaled error.

[markdown] content available only on the platform

Mathematical Foundations for Data Science · Topic 14 · Sampling Distributions and the Central Limit Theorem · printed on November 20, 2026