Regression Artifact — When Logic Wears a Disguise
A regression artifact occurs when individuals are selected for a study or intervention because of extreme scores on a variable that contains measurement error, and subsequent measurements appear to improve simply because extreme scores tend to regress toward the population mean on remeasurement. This regression is a mathematical property of imperfect reliability, not a treatment effect.
Also known as: Regression to the mean, Galton's paradox
How It Works
Any measurement with less than perfect reliability will show regression to the mean when extreme scorers are remeasured. Selection of extreme cases guarantees that the remeasured scores will be less extreme on average.
A Classic Example
Students who score in the bottom 10% on a reading test are enrolled in a remedial reading program. On follow-up testing, their scores improve substantially. However, a control group of equally low-scoring students who received no intervention also improves almost as much, due to regression to the mean.
More Examples
A corporate wellness program enrolls the 15% of employees who scored highest on a stress screening questionnaire. Three months later, their average stress scores have dropped noticeably, and HR declares the program a success. However, extreme scores on any self-report measure naturally drift toward the mean on retesting, regardless of any intervention.
Athletes who have their worst-ever performance in a qualifying round are selected for an experimental sports psychology coaching program. Most of them perform better in the next competition. Coaches attribute the improvement to the program, not recognizing that an unusually bad performance is statistically likely to be followed by a more typical — and better — one.
Where You See This in the Wild
Sports coaches who punish poor performance are surprised when performance improves afterward — regression to the mean, not punishment, is the likely explanation.
How to Spot and Counter It
Include a control group selected by the same extreme-score criterion. Use repeated baseline measurements before treatment. Apply analysis of covariance (ANCOVA) correctly to adjust for regression to the mean.
The Takeaway
The Regression Artifact is one of those reasoning errors that sounds perfectly logical at first glance. That's what makes it dangerous — it wears the costume of valid reasoning while smuggling in a broken conclusion. The best defense? Slow down and ask: does this conclusion actually follow from these premises, or am I just connecting dots that happen to be near each other?
Next time someone presents you with an argument that "just makes sense," check the structure. The feeling of logic is not the same as logic itself.