Attrition Bias — When Logic Wears a Disguise

Attrition bias occurs when participants drop out of a study in ways that are correlated with the treatment or outcome, making the remaining sample unrepresentative of the original population. Unlike random dropout, systematic attrition undermines the comparability of groups that was established at randomization. It is especially problematic in clinical trials when patients who experience side effects or lack of benefit are more likely to withdraw.

Also known as: Dropout bias, Loss-to-follow-up bias, Differential attrition

How It Works

After differential dropout, the groups are no longer comparable on the outcome-relevant characteristics that drove the dropout. Researchers who analyze only completers implicitly compare two self-selected groups.

A Classic Example

A trial of an antidepressant finds that 30% of the treatment group drops out due to side effects, while only 5% of the placebo group drops out. The remaining treatment group consists of people who tolerate the drug well, making it appear more effective and better tolerated than it is for the average patient.

More Examples

A weight-loss app study tracks users over six months. Participants who are not losing weight gradually stop logging meals and eventually delete the app, dropping out of the study. The remaining sample consists disproportionately of successful users, making the app appear far more effective than it is for the average person who downloads it.

A longitudinal study on the effects of a demanding leadership training program finds that participants who complete all 12 modules show large improvements in management ratings. However, the least motivated and lowest-performing managers drop out by module 3, meaning the final results reflect only those who were already high performers and highly committed — not the typical manager the program is designed to help.

Where You See This in the Wild

In dietary intervention trials, participants who find the assigned diet unpalatable are more likely to drop out, leaving only the most compliant participants and inflating apparent efficacy.

How to Spot and Counter It

Report dropout rates and reasons in both groups. Use intention-to-treat analysis. Apply sensitivity analyses such as worst-case imputation or multiple imputation to bound the effect of dropout.

The Takeaway

The Attrition Bias is one of those reasoning errors that sounds perfectly logical at first glance. That's what makes it dangerous — it wears the costume of valid reasoning while smuggling in a broken conclusion. The best defense? Slow down and ask: does this conclusion actually follow from these premises, or am I just connecting dots that happen to be near each other?

Next time someone presents you with an argument that "just makes sense," check the structure. The feeling of logic is not the same as logic itself.