🧪 This platform is in early beta. Features may change and you might encounter bugs. We appreciate your patience!
citation_bias
Citation bias occurs when studies with statistically significant or positive results are cited more frequently than studies with null or negative results. This creates a distorted impression of the state of evidence: highly cited studies appear more authoritative and important, while uncited null studies become invisible. Over time, a false consensus can emerge because researchers, reviewers, and policymakers encounter the positive evidence repeatedly while the contradicting evidence accumulates citations too slowly to influence the discourse.
A landmark study claiming a link between a certain food additive and hyperactivity in children is cited over 1,000 times. Three subsequent studies finding no link are cited fewer than 50 times each. A policy review heavily influenced by citation counts concludes the evidence strongly supports the link.
A widely shared social media post links to a 2015 study claiming a specific gut bacteria supplement boosts memory, which has since accumulated 3,400 citations. Two rigorous randomized controlled trials published in 2017 and 2019 finding no cognitive benefit have been cited 31 and 44 times respectively, and are rarely mentioned in popular science coverage.
In climate policy discussions, a controversial paper suggesting a pause in global warming attracted thousands of citations and extensive media debate. Four methodologically stronger studies published concurrently that reaffirmed the warming trend each received fewer than 200 citations, making the scientific consensus appear more contested than it actually was.
Binary (yes/no) questions an LLM must answer to identify this aspect:
Are studies with significant results cited more frequently than those with null results?
Type: binaryDoes the citing literature selectively reference supportive studies while ignoring contradictory evidence?
Type: binaryCould high citation counts be creating a false impression of the strength of evidence?
Type: binaryHas the citing paper conducted a balanced review of both supportive and contradictory studies?
Type: binaryCitation bias occurs when studies with statistically significant or positive results are cited more frequently than studies with null or negative results. This creates a distorted impression of the state of evidence: highly cited studies appear more authoritative and important, while uncited null studies become invisible. Over time, a false consensus can emerge because researchers, reviewers, and policymakers encounter the positive evidence repeatedly while the contradicting evidence accumulates citations too slowly to influence the discourse.
Researchers naturally cite studies that support their arguments, and positive results are more memorable and discussion-worthy. Citation counts are used as a proxy for importance and quality, creating a feedback loop where well-cited studies attract more citations regardless of whether their findings have been replicated or refuted.
Conduct systematic rather than narrative literature reviews. Do not use citation counts as evidence of research quality. Actively search for and cite null and contradictory findings. Use citation analysis tools to identify potentially under-cited disconfirming evidence.
Documented across scientific disciplines. Studies have shown that in some fields, supportive studies are cited up to four times more often than equally valid unsupportive studies.
Studies with statistically significant or positive results are more likely to be published, while null results remain unpublished. This distorts the published literature and inflates apparent effect sizes in meta-analyses.
Significant results appear in higher-impact journals, amplifying their visibility.
Selective sharing of research findings based on the direction or significance of results.
Significant results are published faster, distorting the evidence base at any point in time.
Research funded by parties with financial interests tends to produce favorable results.
Use these tools to detect, analyze, or train this aspect.