Content
Summary
This lesson defines the foundational elements of probability, including experiments, trials, outcomes, and sample spaces. It distinguishes between theoretical and experimental probability, explains the Law of Large Numbers, and introduces set operations like union, intersection, and conditional probability.
Intuition
Think of probability as a measure of certainty for the results of a planned operation under controlled conditions, known as an experiment. If the result isn't predetermined, it's a chance experiment. Each attempt is a trial, and the result is an outcome. The sample space is the complete list of all possible outcomes. An event is just a subset of these outcomes. We calculate probability either theoretically (by counting favorable outcomes in an equally likely space) or experimentally (by observing real-world frequencies). A key insight is that while short-term results vary, long-term experimental frequencies converge to theoretical probabilities, a principle known as the Law of Large Numbers. Finally, we use set operations like union (OR) and intersection (AND) to combine events, and conditional probability to update likelihoods when new information restricts our sample space.
Key equations
Theoretical probability for equally likely outcomes.
The sum of an event's probability and its complement's probability is 1.
Conditional probability of A given B, where the sample space is reduced to B.
Derivation
- Define an experiment as a planned operation under controlled conditions.
- Identify a chance experiment where results are not predetermined.
- Define a trial as an individual attempt and an outcome as the result.
- Construct the sample space as the set of all possible outcomes.
- Define an event as a subset of the sample space.
- Assign probability values between 0 (impossible) and 1 (certain).
- For equally likely outcomes, calculate theoretical probability by dividing favorable outcomes by total outcomes.
- For biased or empirical cases, calculate experimental probability by dividing observed occurrences by total trials.
- Apply the Law of Large Numbers: experimental probability converges to theoretical probability as trials increase.
- Use set operations: Union () for OR, Intersection () for AND.
- Define Complement () as outcomes in not in .
- Calculate Conditional Probability by restricting the sample space to .
Worked example
Roll a standard six-sided die. Let A be rolling an even number, and B be rolling a number less than four. Find P(A|B).
- Identify the sample space S = {1, 2, 3, 4, 5, 6}.
- Define event A (even numbers) = {2, 4, 6}.
- Define event B (less than four) = {1, 2, 3}.
- For P(A|B), the condition is B, so the new sample space is {1, 2, 3}.
- Identify outcomes in A that are also in B: A ∩ B = {2}.
- Count favorable outcomes in the reduced space: 1 outcome (2).
- Count total outcomes in the reduced space: 3 outcomes (1, 2, 3).
- Calculate probability: 1/3.
Answer 1/3
Common mistakes
- Expecting theoretical probability to predict short-term results exactly.
- Assuming all outcomes are equally likely without verifying physical fairness.
- Confusing P(A|B) with P(B|A) by failing to identify which event restricts the sample space.
- Double-counting outcomes when listing the union (OR) of two events.