Statistics & Probability: notes and practice questions
The largest SL topic by a wide margin, 36 hours, and the heart of what makes AI distinct from AA: sampling, data presentation, measures of central tendency and dispersion, correlation, probability from Venn diagrams through conditional probability, discrete random variables, and the binomial and normal distributions. HL adds non-linear regression and , linear transformations of random variables, the central limit theorem, confidence intervals, the Poisson distribution, hypothesis testing with and -tests, and Markov chains with transition matrices. The hard parts are choosing the right test or distribution for a context, and at HL, reading a hypothesis test's conclusion back into the scenario correctly rather than just stating a p-value.
Subtopics
- Practice questionsStats basics (population, 5 sampling techniques, outlier definition)
Qualitative data is descriptive, non-numerical. Samples may not be representative of the entire population; minimise bias with random sampling.
- Practice questionsPresentation of data (frequency distribution tables, histograms, box & whisker, cumulative frequency graphs + using to find median quartiles, percentiles, range, IQR)
Univariate Data: Data in a single variable. Mode: The most common value.
- Practice questionsMeasures of central tendency / dispersion (std. Dev, var, IQR) + effect of constant changes to data
Measures of Central Tendency:. Mode: Most frequent value.
- Practice questionsLinear Correlation of bivariate data (scatter diagrams, lines of best fit, Pearson) + regression line interpretation
Bivariate Data: Data on two variables, paired to examine relationships. Correlation vs. Causation: Correlation does not imply causation.
- Practice questionsProbability basics (expected #, complementary events, probability of event)
**Expected Value ():** The mean of a random variable . Expected Number of Occurrences: For trials with success probability , expected occurrences are .
- Practice questionsVenn diagrams, tree diagrams, probability tables (+ notation & combined & mutually exclusive events)
Probability uses diagrams and notation to model combined events. Mutually Exclusive Events: Cannot occur together. . So, .
- Practice questionsConditional probability and independent events
Conditional Probability: Event A occurs given event B has already occurred. Independent Events: Occurrence of one does not affect the probability of the other; and .
- Practice questionsProbability distribution of discrete random variables (table + applications)
A random variable's value depends on a random event's outcome. A discrete random variable takes specific, separate values (e.g., non-negative integers).
- Practice questionsBinomial distribution
A discrete random variable's value depends on a random event, unknown until carried out. A discrete probability distribution lists all possible discrete outcomes and their probabilities.
- Practice questionsNormal distribution + bell curve (+inv normal)
Normal distribution is a continuous probability distribution. Notation: , where is the population mean and is the population variance.
- Practice questionsSpearman’s rank (+ limitations of pearson / spearman)
Spearman's Rank Correlation Coefficient () measures the strength and direction of a monotonic relationship between two variables. A monotonic function either only increases or only decreases.
- Practice questionsChi GOF, Independence, T-test (Null / Alternative hypothesis, S.L. / p-values)
Hypothesis Test: Uses sample data to test a statement about a population. Null Hypothesis (): Assumes no difference, no change, no association, or data follows a specific distribution.
- Practice questionsDesigning/Analysing Data Collection Methods (surveys), Categorizing Data & choosing DOF for Chi, Reliability/Validity testsHL only
Qualitative Data: Expressed in words, grouped into categories for statistical analysis. Chi-squared Test for Independence: Determines association between two categorical variables; null hypothesis: variables are independent.
- Practice questionsNon-linear Regression, Evaluating least squares regression, sum of squares, and R^2HL only
Non-linear regression: Used when a curve fits bivariate data better than a straight line. Residual: Difference between actual and predicted value: .
- Practice questionsLinear transformation of random variable(s), unbiased estimate of mean and varHL only
An estimator is a random variable; an estimate is its numerical value from a sample. An estimator is unbiased (HL) if its expected value equals the population parameter: .
- Practice questionsCentral limit theorem + Linear combination of multiple independent NORMAL random variablesHL only
For a single random variable `X` and constants `a, b`: .
- Practice questionsConfidence intervalsHL only
Confidence Intervals for the Mean (with Sample Mean Distribution & Central Limit Theorem) are HL syllabus. The sample mean () is used as a point estimate for the population mean ().
- Practice questionsPoisson distributionHL only
Poisson Distribution: Discrete probability distribution modeling the number of occurrences of an event in a fixed interval. Conditions: Occurrences are independent and happen at a uniform average rate.
- Practice questionsCritical Values/Regions, Population Mean Tests (normal/poisson), Proportion Tests (binomial), Correlation Hypothesis Testing, and Type I/II ErrorsHL only
Hypothesis Test: Uses sample data to evaluate a statement about a population parameter. Null Hypothesis (): Default statement (no change, no difference, or no correlation).
- Practice questionsTransition matrices (higher powers), Markov chains, steady state and long term probabilitiesHL only
State: A mutually exclusive event that can change over time. Markov Chain: A mathematical model describing a sequence of states over discrete time steps.