Apps

🧪 This platform is in early beta. Features may change and you might encounter bugs. We appreciate your patience!

Ascertainment Bias

Also Known As: Referral Bias Detection Filter Bias
Statistical Error ID: ascertainment_bias

Definition

Ascertainment bias occurs when the method of identifying study participants systematically distorts the sample composition. The way cases are detected, referred, or selected determines who ends up in the study, and if this process favors certain characteristics, the results will not reflect the true population. This is especially common in clinical and genetic studies.

Examples

A genetic study recruits families through hospitals, finding a strong association between a gene variant and a rare disease. However, families with multiple affected members are more likely to seek medical attention, inflating the apparent genetic risk.

A public health department tracks opioid overdose rates using emergency room records and concludes that overdoses are concentrated in urban areas. Rural overdoses that result in death before an ambulance arrives or are misclassified as accidents never enter the hospital system, making rural areas appear far safer than they are.

An online survey about social media addiction is promoted through Facebook and Instagram, recruiting participants who are already active users. People who have quit social media entirely due to addiction problems are unreachable through this channel, so the most severe cases are systematically missed.

Verification Steps
Verification Steps
Binary yes/no questions that an AI must answer to detect a reasoning pattern in a text.
Each of the 452 aspects has verification steps — simple yes/no questions designed to systematically detect whether a pattern appears in a text. For ad hominem: "Does the argument attack a person rather than their claim?" For false dichotomy: "Are only two options presented when more exist?" This ensures consistent, reproducible analysis.

Binary (yes/no) questions an LLM must answer to identify this aspect:

  1. 1

    Were participants identified or recruited through a method that could favor certain types of cases?

    Type: binary
  2. 2

    Could the detection or referral process systematically overrepresent certain conditions or demographics?

    Type: binary
  3. 3

    Does the sample source (hospital, clinic, database) introduce a systematic skew?

    Type: binary
  4. 4

    Are findings generalized beyond the specific population from which cases were ascertained?

    Type: binary
Deep Dive
The expandable detail section on each aspect page with examples, psychology, and counter-strategies.
The Deep Dive section provides in-depth information about each aspect: a real-world example showing the pattern in action, an explanation of why it works psychologically, practical advice on how to counter it, alternative names, and links to related aspects.

Hierarchical Context