Back to the lessonPreparing the printout…

Mathematical Foundations for Data Science · Part III — Probability and Statistics

Topic 10 · Probability Foundations

[video] Lecture video — Topic 10: Probability Foundations — /api/lesson-media/videos/4d3653ff-a3ca-4f63-bf8e-bb93c553e599-1794892502486-df74459a374bfef7.mp4

Flashcards · Probability Foundations

Sample space — The set S of all possible outcomes of an experiment.

One die roll: S = {1, 2, 3, 4, 5, 6}.

Event — A subset of the sample space; it occurs when the outcome belongs to it.

Exactly one head in two tosses is {HT, TH}.

Complement — Aᶜ = S \ A, the event that A does not occur; P(Aᶜ) = 1 − P(A).

Addition rule — P(A ∪ B) = P(A) + P(B) − P(A ∩ B).

0.4 + 0.5 − 0.2 = 0.7.

Conditional probability — P(A | B) = P(A ∩ B) / P(B), defined when P(B) > 0.

P(A ∩ B) = 0.12 and P(B) = 0.30 give 0.40.

Independent events — P(A ∩ B) = P(A)P(B), equivalently P(A | B) = P(A).

Two fair coins: first heads and second heads.

Mutually exclusive events — A ∩ B is empty. With positive probabilities they are never independent.

Law of total probability — P(A) = Σ P(A | Bi)P(Bi) over a partition B1, …, Bk.

0.10(0.60) + 0.30(0.40) = 0.18.

Bayes' rule — P(Bj | A) = P(A | Bj)P(Bj) / Σ P(A | Bi)P(Bi): it reverses a conditional using the base rates.

1% prevalence, 90% sensitivity, 10% false positives give P(D | +) = 1/12.

[markdown] content available only on the platform

Mathematical Foundations for Data Science · Topic 10 · Probability Foundations · printed on November 20, 2026