Topic 15 · Statistical Estimation and Confidence Intervals
[video] Lecture video — Topic 15: Statistical Estimation and Confidence Intervals — /api/lesson-media/videos/4d3653ff-a3ca-4f63-bf8e-bb93c553e599-1794840944519-0346d58b05a3edaa.mp4
Flashcards · Estimation and Confidence Intervals
Parameter, statistic, estimator, estimate — A parameter is a fixed population quantity; a statistic is a function of the sample; an estimator is a statistic used for a parameter (random); an estimate is its observed value.
p, K, p̂ = K/n, and 40/200 = 0.20.
Bias — B(θ̂) = E(θ̂) − θ. Unbiased means E(θ̂) = θ for every parameter value in the model.
Mean square error — MSE(θ̂) = E[(θ̂ − θ)²] = V(θ̂) + [B(θ̂)]².
A: 0.04 + 0 = 0.04; B: 0.02 + 0.10² = 0.03.
Sample variance — S² = Σ(Xi − X̄)² / (n − 1), unbiased for σ². The normal MLE uses n and is biased by the factor (n − 1)/n.
Data 1, 3, 5: s² = 8/2 = 4.
Confidence interval for a proportion — p̂ ± z·√(p̂(1 − p̂)/n), with z = 1.96 for 95%; approximate.
40/200: [0.145, 0.255].
Confidence interval for a normal mean — x̄ ± t·s/√n with t from the t distribution with n − 1 degrees of freedom.
n = 16, x̄ = 10, s = 4: [7.869, 12.131].
Meaning of confidence level — The long-run fraction of intervals, built by the procedure over repeated samples, that contain the fixed parameter.
Efficiency and consistency — eff(θ̂1, θ̂2) = V(θ̂2) / V(θ̂1) for unbiased estimators; above 1 favours θ̂1. θ̂n is consistent if P(|θ̂n − θ| > ε) → 0 as n → ∞.
Variances 4 and 9: eff = 9/4.
Method of moments — Set population moments (functions of the parameters) equal to sample moments and solve.
Uniform(0, θ): θ/2 = x̄, so θ̂ = 2x̄.
Maximum likelihood — Choose the parameter that maximizes the likelihood of the observed data; usually maximize the log-likelihood.
8 successes, 12 failures: p̂ = 8/20 = 0.40.
[markdown] content available only on the platform
