Exclusion Bias — When Logic Wears a Disguise
Exclusion bias arises when the criteria used to select or filter study participants systematically remove individuals whose inclusion would change the study's results. This can happen through overly strict eligibility criteria, loss to follow-up, or removal of outliers. The remaining sample no longer represents the target population.
Also known as: Selection Exclusion Bias
How It Works
Exclusion criteria often seem reasonable on the surface (safety, data quality), making it easy to overlook how they shape results. Readers rarely scrutinize who was excluded and why, focusing instead on the reported outcomes.
A Classic Example
A clinical trial for an antidepressant excludes patients with suicidal ideation. The drug appears effective and safe, but its performance in the most severe cases — the very patients most likely to need it — remains unknown.
More Examples
A vaccine efficacy trial excludes participants with autoimmune conditions. The vaccine shows strong immune responses across the study group, but the findings cannot be applied to millions of immunocompromised individuals who were never studied and may respond very differently.
A workplace productivity app study excludes employees who dropped out in the first week due to technical difficulties. The remaining users show impressive engagement metrics, but the early dropouts — likely those who struggled most with the technology — represent exactly the population the app was designed to help.
Where You See This in the Wild
Drug trials routinely exclude elderly patients, pregnant women, and people with comorbidities. When these drugs are approved and prescribed broadly, their real-world effectiveness and safety may differ substantially from trial results.
How to Spot and Counter It
Scrutinize inclusion and exclusion criteria carefully. Ask who is missing from the study and how their absence might affect results. Look for intention-to-treat analyses that include all originally enrolled participants.
The Takeaway
The Exclusion Bias is one of those reasoning errors that sounds perfectly logical at first glance. That's what makes it dangerous — it wears the costume of valid reasoning while smuggling in a broken conclusion. The best defense? Slow down and ask: does this conclusion actually follow from these premises, or am I just connecting dots that happen to be near each other?
Next time someone presents you with an argument that "just makes sense," check the structure. The feeling of logic is not the same as logic itself.