Source Selection Bias — When Logic Wears a Disguise
Source Selection Bias occurs when a speaker or media outlet systematically chooses sources that confirm a predetermined narrative while excluding equally credible sources that offer contradicting evidence or perspectives. Unlike cherry picking (which selects data), source selection bias operates at the level of who gets to speak — which experts are quoted, which studies are cited, which witnesses are interviewed. The result is an artificially one-sided picture that appears well-sourced.
Also known as: Expert Shopping, Selective Sourcing, Biased Expert Selection, One-Sided Sourcing
How It Works
The presence of named sources and citations creates an appearance of journalistic rigor. Audiences assume that if experts were consulted, the reporting must be balanced. They rarely check whether equally qualified experts with opposing views were deliberately excluded.
A Classic Example
A news report on climate policy interviews three industry-funded economists who oppose regulation but no climate scientists, environmental economists, or public health experts who support it.
More Examples
A documentary about nutrition exclusively features advocates of one dietary philosophy while ignoring the broader scientific consensus.
A political talk show consistently invites guests from one end of the political spectrum, creating the impression that expert opinion uniformly supports one party's position.
Where You See This in the Wild
Common in partisan media where the same ideologically aligned commentators are repeatedly featured, in pharmaceutical reporting that only quotes company-funded researchers, in political coverage that only interviews one party's representatives, and in tech journalism that relies solely on industry insiders.
How to Spot and Counter It
Examine the source pool: 'Who was consulted and who was left out? Are all relevant perspectives represented? Do the sources have conflicts of interest?' Look for diversity in expertise, institutional affiliation, and viewpoint. Compare coverage across multiple outlets.
The Takeaway
The Source Selection Bias is one of those reasoning errors that sounds perfectly logical at first glance. That's what makes it dangerous — it wears the costume of valid reasoning while smuggling in a broken conclusion. The best defense? Slow down and ask: does this conclusion actually follow from these premises, or am I just connecting dots that happen to be near each other?
Next time someone presents you with an argument that "just makes sense," check the structure. The feeling of logic is not the same as logic itself.