🧪 This platform is in early beta. Features may change and you might encounter bugs. We appreciate your patience!
convenience_sampling_bias
Convenience sampling bias arises when researchers sample whoever is most easily accessible rather than drawing a representative sample from the target population. The most pervasive example is psychology's over-reliance on WEIRD (Western, Educated, Industrialized, Rich, Democratic) samples, particularly American undergraduates, for conclusions claimed to be universally human.
Most foundational psychology studies on cooperation, fairness, and decision-making used US undergraduate students as subjects. When replicated with non-WEIRD populations, many results failed to hold, revealing the sample-specific nature of the original findings.
A nutritionist studies the eating habits of 'average adults' by surveying patrons at a health food café near her university. The sample is overwhelmingly health-conscious and educated, producing dietary patterns far removed from those of the general population.
A political scientist tests a new survey instrument about civic engagement by distributing it to attendees at a local town hall meeting. Since town hall attendees are already unusually politically active, the instrument appears to detect high engagement everywhere it is later deployed, masking its inability to capture apathetic or disengaged citizens.
Binary (yes/no) questions an LLM must answer to identify this aspect:
Was the sample selected based on ease of access rather than representativeness?
Type: binaryDoes the sample consist predominantly of a narrow demographic (e.g., university students, clinic patients)?
Type: binaryAre findings generalized beyond the sampled population?
Type: binaryIs the sample described as WEIRD (Western, Educated, Industrialized, Rich, Democratic)?
Type: binaryConvenience sampling bias arises when researchers sample whoever is most easily accessible rather than drawing a representative sample from the target population. The most pervasive example is psychology's over-reliance on WEIRD (Western, Educated, Industrialized, Rich, Democratic) samples, particularly American undergraduates, for conclusions claimed to be universally human.
Undergraduate samples are cheap, available, and compliant. Researchers rationalize that cognitive and social processes are universal enough to generalize, but this assumption is rarely tested.
Ask who was sampled and why. Evaluate whether the population of interest matches the sample. Look for cross-cultural replications before accepting universal claims.
A 2010 meta-analysis found that US undergraduates are among the most psychologically unusual populations on Earth on dimensions like individualism and visual perception, yet represent the bulk of the psychology literature.
Use these tools to detect, analyze, or train this aspect.