Content
Summary
A 95% confidence interval is produced by a procedure that, over many repeated studies, captures the true population parameter about 95% of the time. Any single interval either contains the true value or it does not. Coverage describes the long-run success rate of the method, not the probability for one interval.
Intuition
Imagine the true mean blood pressure of a population is a fixed but unknown number. You draw a sample, compute a mean and a margin of error, and get an interval. Another researcher draws a different sample and gets a slightly different interval. Because samples vary, the intervals bounce around the fixed true value like horseshoes thrown at a stake. The method is designed so that about 95 out of 100 horseshoes land around the stake. In the simulation, we repeat the study many times, draw each interval as a horizontal bar, and color it green if it covers the true mean and red if it misses. The fraction of green bars approaches 95% as the number of repetitions grows. Small samples with the wrong method, or skewed data, can make actual coverage fall below the nominal level.
Key equations
95% confidence interval for a population mean from a sample of size n with sample mean x-bar and standard deviation s.
Before data are collected, the random interval [L, U] covers the fixed mean with probability 0.95.
Simulated coverage: the proportion of repeated intervals that contain the true value.
Standard error, which measures how much sample means vary from sample to sample.
Derivation
- Start with the sampling distribution: for a Normal population, the quantity divided by follows a t distribution with degrees of freedom.
- Choose the critical value t* so that 95% of that distribution lies between minus t* and plus t*.
- Write the probability statement: .
- Rearrange the inequality to isolate : .
- The endpoints depend on the random sample, so the interval is random while is fixed. Hence 95% of such intervals contain in repeated sampling.
Worked example
A sample of n = 25 patients has mean systolic blood pressure 128 mmHg and standard deviation 15 mmHg. Compute the 95% CI for the population mean. (t with 24 df, 0.975 quantile = 2.064.)
- Compute the standard error: SE = 15 / = 15 / 5 = 3.
- Compute the margin of error: 2.064 × 3 = 6.19.
- Lower limit: 128 - 6.19 = 121.81.
- Upper limit: 128 + 6.19 = 134.19.
Answer 95% CI is approximately 121.8 to 134.2 mmHg.
Common mistakes
- Saying there is a 95% probability that the true mean lies in this particular computed interval; the true mean is fixed, and this interval either contains it or not.
- Thinking 95% of individual patient values fall within the interval; it concerns the mean, not individuals.
- Believing that a narrower interval means higher confidence; at fixed confidence, narrower comes from larger n or less variability.
- Assuming that non-overlapping or overlapping intervals from two studies automatically decide significance.
- Ignoring that coverage can fall below 95% for small, skewed samples or biased designs.