Lord's Paradox — When Logic Wears a Disguise
A statistical paradox where two legitimate analytical methods applied to the same data yield opposite conclusions. Typically arises when comparing groups on change scores versus using analysis of covariance (ANCOVA) to adjust for baseline differences. The choice of method encodes different causal assumptions.
Also known as: Lord's Statistical Paradox
How It Works
Different statistical methods answer subtly different questions. Without clarity about the causal model and the specific question being asked, analysts can unknowingly choose the method that produces their preferred answer.
A Classic Example
Comparing weight change between men and women: raw change scores show no difference, but ANCOVA adjusting for initial weight shows women gained more. Both analyses are mathematically correct but make different assumptions.
More Examples
A school district tests two teaching methods by measuring reading scores at the start and end of the year. A simple analysis of score gains shows no difference between methods. But when analysts adjust for students' starting scores using ANCOVA, Method B appears significantly better — both analyses use the same data and are statistically valid.
A clinical trial compares two diets for weight loss. Analyzing the raw pounds lost per group shows Diet A wins. But when researchers control for participants' baseline weight, Diet B appears superior because heavier participants — who lose more in absolute terms — were unevenly distributed across groups. Both conclusions are mathematically defensible.
Where You See This in the Wild
Education research (pre-post test comparisons), clinical trials, program evaluation, and any pre-post group comparison study.
How to Spot and Counter It
Explicitly state the causal model and research question before choosing a statistical method. Different causal assumptions require different analytical approaches.
The Takeaway
The Lord's Paradox is one of those reasoning errors that sounds perfectly logical at first glance. That's what makes it dangerous — it wears the costume of valid reasoning while smuggling in a broken conclusion. The best defense? Slow down and ask: does this conclusion actually follow from these premises, or am I just connecting dots that happen to be near each other?
Next time someone presents you with an argument that "just makes sense," check the structure. The feeling of logic is not the same as logic itself.