🧪 This platform is in early beta. Features may change and you might encounter bugs. We appreciate your patience!
location_bias
Location bias occurs when the journal or venue in which a study is published depends on the direction or significance of its results. Significant and positive findings tend to appear in high-impact, widely indexed, English-language journals, while null or negative results are published in lower-impact, regional, or non-indexed journals. This means standard literature searches systematically over-represent positive findings, because they disproportionately capture studies from prominent sources.
A researcher conducts a systematic review by searching major medical databases. They find 15 studies showing a drug is effective, all in top-tier journals. Five studies showing no effect were published in regional journals not indexed in those databases. The review concludes the drug is effective, missing one-quarter of the evidence.
A meta-analysis on mindfulness-based therapy for anxiety pulls studies from top psychology journals and finds overwhelming support for the intervention. A later comprehensive search uncovers a dozen null-result studies published only in regional or institutional journals that rarely appear in standard database searches, significantly weakening the overall effect size.
A team reviewing workplace diversity training programs finds that every study in major management journals reports positive outcomes. After contacting researchers directly, they discover several unflattering evaluations were only written up as internal corporate reports or presented at small local conferences, never reaching the indexed literature.
Binary (yes/no) questions an LLM must answer to identify this aspect:
Are studies with significant results being published in more prominent or accessible journals?
Type: binaryCould the visibility of a finding be influenced by the magnitude or direction of its results?
Type: binaryAre null or negative findings relegated to less visible, less indexed, or non-English journals?
Type: binaryDoes a literature search over-represent significant results because of where they are published?
Type: binaryLocation bias occurs when the journal or venue in which a study is published depends on the direction or significance of its results. Significant and positive findings tend to appear in high-impact, widely indexed, English-language journals, while null or negative results are published in lower-impact, regional, or non-indexed journals. This means standard literature searches systematically over-represent positive findings, because they disproportionately capture studies from prominent sources.
High-impact journals preferentially accept studies with novel, significant results. Authors submit their strongest findings to the best journals. Standard literature searches focus on major databases that index prominent journals, creating a self-reinforcing cycle where positive results are both more prominently placed and more easily found.
Search broadly across databases, including regional and non-English sources. Include gray literature and conference proceedings in systematic reviews. Use methods that estimate and correct for publication bias (e.g., funnel plots, trim-and-fill analysis). Contact researchers directly for unpublished results.
Affects systematic reviews and meta-analyses in medicine, psychology, and education, where the comprehensiveness of the literature search directly determines the validity of conclusions.
Studies with statistically significant or positive results are more likely to be published, while null results remain unpublished. This distorts the published literature and inflates apparent effect sizes in meta-analyses.
Studies with significant results are cited disproportionately more often.
Selective sharing of research findings based on the direction or significance of results.
Significant results are published faster, distorting the evidence base at any point in time.
Research funded by parties with financial interests tends to produce favorable results.
Use these tools to detect, analyze, or train this aspect.