| Mean | |
|---|---|
| Standard deviation | |
| Outlier fences |
Lesson
The theory — Describing Distributions
To describe a distribution is to give its shape, its centre, its spread and any unusual values, in the context of the data. To compare two is to say how each of those differs, with numbers.
Where the formula comes from
- Shape. Look at a dotplot or histogram: one peak or more, roughly symmetric or with a longer tail to the right (skewed right) or to the left, and any gaps or clusters. The skewness g₁ puts a number on the tail: positive for a long right tail.
- Centre. The mean is the balance point of the data; the median has at least half the values at or below it and at least half at or above it. One extreme value can move the mean a long way and the median hardly at all, so the median is called resistant.
- Spread. The standard deviation s measures typical distance from the mean, dividing by n − 1 because the deviations from x̄ must add to zero. The IQR is the spread of the middle half and, like the median, resists extreme values. The range uses only the two most extreme.
- Unusual values. A value more than 1.5 IQR below Q₁ or above Q₃ is an outlier. A value exactly on a fence is not.
- Choose the pair that suits the shape. For a roughly symmetric distribution with no outliers, report the mean and s; when it is skewed or has outliers, report the median and the IQR. To compare two groups, use the same pair for both, on the same scale, and say which is larger and by how much.
- Assumes
- Quartiles depend on the rule. The switch offers three: the halves of the TI-84, and types 7 and 6 of Hyndman and Fan, the defaults in R and in Minitab and SPSS. They can disagree on a data set of any size.
Problems solved in full
-
Describing one distribution 3 steps
Describe the distribution of Old Faithful’s 175 waits after an eruption of 3 minutes or more: n = 175, mean 79.99, s = 5.99, minimum 64, Q₁ = 76, median 80, Q₃ = 84, maximum 96, skewness −0.04.
-
Shape: the dotplot has a single peak and the tails are about equally long; the skewness is close to zero.
-
Centre and spread: the shape is roughly symmetric, so the mean and standard deviation are fair summaries. Check for outliers with the fences:
-
64 and 96 sit exactly on the fences, and a value on a fence is not an outlier.
Answer
Single-peaked and roughly symmetric, centred near 80 minutes (mean 79.99, median 80), with a standard deviation of about 6 minutes and waits from 64 to 96; no outliers.
-
-
Mean and standard deviation by hand 3 steps
Nine students spent 10, 15, 19, 20, 23, 29, 29, 31 and 49 minutes on homework. Find the mean and the standard deviation.
Show solution
-
Add the values and divide by n:
-
Square each deviation from the mean and add the squares:
-
Divide by n − 1 = 8 and take the square root:
Answer
x̄ = 25 minutes, s ≈ 11.37 minutes.
-
-
Which summaries resist an outlier 2 steps
Newcomb’s 66 timings have mean 26.21, standard deviation 10.75, median 27 and IQR 7. Without the two outliers, −44 and −2, the 64 that remain have mean 27.75, standard deviation 5.08, median 27.5 and IQR 6.5. Which summaries changed most, and which pair should describe the full data?
Show solution
-
Compare each summary with and without the two values:
-
The standard deviation more than halves and the mean moves by 1.54, while the median and the IQR move by 0.5 each. The outliers pull hard on the non-resistant measures.
Answer
The mean and especially the standard deviation changed most. The full data, with its two outliers, are best described by the median, 27, and the IQR, 7.
-
-
Comparing two distributions 2 steps
Compare the waits after short eruptions (n = 97: median 54, Q₁ 50, Q₃ 59, range 43 to 71, skewness 0.30) with the waits after long ones (n = 175: median 80, Q₁ 76, Q₃ 84, range 64 to 96, skewness −0.04).
Show solution
-
Centre: the medians differ by:
-
Spread: the IQRs are 9 and 8 minutes, nearly the same. Shape: both single-peaked; the short-eruption waits have a slightly longer right tail. Unusual values: none in either group by the fences. Overlap:
Answer
Waits after a long eruption are typically 26 minutes longer (medians 80 against 54), with about the same spread (IQRs 8 and 9) and no outliers in either group. The middle half of the long-eruption waits, 76 to 84, lies wholly above the middle half of the short-eruption ones, 50 to 59.
-
-
The same data, two quartile rules 2 steps
For 10, 15, 19, 20, 23, 29, 29, 31, 49, find Q₁ and Q₃ by the halves method and by type 7, h = (n − 1)p + 1, and decide each time whether 49 is an outlier.
Show solution
-
Halves: leave out the median, 23, and take the median of each four:
-
Type 7: h = 8 × 0.25 + 1 = 3 and h = 8 × 0.75 + 1 = 7, so Q₁ and Q₃ are the 3rd and 7th values:
Answer
Halves: Q₁ = 17, Q₃ = 30, fence 49.5, so 49 is not an outlier. Type 7: Q₁ = 19, Q₃ = 29, fence 44, so 49 is an outlier.
-
-
Changing the units 2 steps
Newcomb recorded each timing t as a code x, where t = 24.8 + x/1000 millionths of a second. The codes have mean 26.21, standard deviation 10.75, median 27 and IQR 7. Find the same four summaries for t.
Show solution
-
Adding a constant moves every measure of centre and leaves spread alone; multiplying by a positive constant scales both. Centre:
-
Spread, multiplied by 1/1000 only:
Answer
Mean 24.82621 and median 24.827 millionths of a second; standard deviation 0.01075 and IQR 0.007.
-
-
When the mean and median disagree with the tail 3 steps
In 100 households, 38 have one adult, 49 have two, 9 have three, 3 have four and 1 has five. Find the mean and the median, and say which way the distribution is skewed.
Show solution
-
The mean:
-
The median is the mean of the 50th and 51st values. The first 38 are 1 and values 39 to 87 are 2:
-
The tail runs to the right, to 4 and 5 adults, and the skewness is positive:
Answer
Mean 1.8, median 2, skewed right (g₁ ≈ 1.2): the mean is below the median even though the long tail is on the right.
-
Supplementary problems, answers only
-
Find the mean and standard deviation of 2, 4, 4, 4, 5, 5, 7, 9.
Show answer
x̄ = 5, s ≈ 2.14
-
A data set has Q₁ = 12 and Q₃ = 20. Which of 0, 8, 32 and 33 are outliers?
Show answer
Only 33. The fences are 0 and 32, and a value on a fence is not an outlier.
-
Every value in a data set is multiplied by 3 and then 5 is added. What happens to the mean, the median, the standard deviation and the IQR?
Show answer
The mean and median become 3 × (old) + 5; the standard deviation and IQR are multiplied by 3.
-
Test scores are strongly skewed left with two very low scores. Which measures of centre and spread should a report use?
Show answer
The median and the IQR.
-
For 10, 15, 19, 20, 23, 29, 29, 31, 49, find Q₁ and Q₃ by type 6, h = (n + 1)p.
Show answer
Q₁ = 17, Q₃ = 30
Learning path
Statistics: from data to proportions
References (6)
- Insight block 3 and solved problem 7: the textbook rule that the mean lies towards the long tail, found in 14 of 18 introductions, failing for adults per US household in the 2002 General Social Survey (skewness 1.11, 38% of cases below the median, 49% at it, 13% above), and why discrete data break it: von Hippel, P. T. (2005). Mean, median, and skew: Correcting a textbook rule. Journal of Statistics Education, 13(2).
- Insight block 2: the definitions of sample quantiles in use in statistical packages, compared, and the observation that one package can use one definition for a quantile and another for its boxplot: Hyndman, R. J. & Fan, Y. (1996). Sample quantiles in statistical packages. The American Statistician, 50(4), 361–365.
- Types 6 and 7 as the page computes them: type 7 is R's default, type 6 is the one Minitab and SPSS use: R Core Team. quantile: Sample Quantiles. R stats package documentation.
- A standard AP Statistics text showing the TI-83/84 and Minitab giving different quartiles for the same data, and the TI-83/84's 1-Var Stats as the five-number summary: Starnes, D. S. & Tabor, J. The Practice of Statistics, 7th edition. New York: Bedford, Freeman & Worth, 2024; page 75.
- Old Faithful's waits and eruption lengths, split at 3 minutes for the first preset; R documents the waiting column as the time to the next eruption: R Core Team. faithful: Old Faithful Geyser Data. R datasets package documentation; source: Härdle, W. (1991). Smoothing Techniques: With Implementation in S. New York: Springer.
- Newcomb's 66 timings and the code t = 24.8 + x/1000 millionths of a second used in solved problem 6: Stigler, S. M. (1977). Do robust estimators work with real data? The Annals of Statistics, 5(6), 1055–1098.