🧪 This platform is in early beta. Features may change and you might encounter bugs. We appreciate your patience!
demand_characteristics
Demand characteristics bias occurs when participants detect cues about what the study hypothesis is and alter their responses accordingly — either to confirm expectations (helping behavior) or to subvert them (screw-you effect). First systematically described by Martin Orne, this bias undermines the validity of self-report data and experimental findings, particularly when the study design makes its purpose transparent.
In a study ostensibly about 'creativity and mental states,' participants who receive positive mood inductions before a creativity task may produce more creative work partly because they infer that the study expects mood to boost creativity and consciously try to meet that expectation.
Participants in a study described as examining 'the relationship between power poses and confidence' adopt expansive postures during the waiting period before the task begins — before any instruction is given — because they have already inferred what the researcher expects and want to be helpful subjects.
In a wine tasting experiment, participants are told beforehand that the study concerns 'how expertise shapes perception.' Novice drinkers, not wanting to appear unsophisticated, give more complex and nuanced tasting notes than they would in a blind, context-free evaluation — conforming to what they believe an expert response should look like.
Binary (yes/no) questions an LLM must answer to identify this aspect:
Could participants have inferred the study's hypothesis from experimental cues?
Type: binaryIs there reason to believe participants altered responses to confirm or deny the expected hypothesis?
Type: binaryWere deception or cover stories used to mask the true study purpose?
Type: binaryDo self-report measures align with behavioral or physiological measures?
Type: binaryDemand characteristics bias occurs when participants detect cues about what the study hypothesis is and alter their responses accordingly — either to confirm expectations (helping behavior) or to subvert them (screw-you effect). First systematically described by Martin Orne, this bias undermines the validity of self-report data and experimental findings, particularly when the study design makes its purpose transparent.
Participants are not passive subjects but active interpreters who construct theories about what researchers want. Social desirability and compliance motives push responses toward the perceived expectation.
Use cover stories or indirect measurement. Check alignment between self-report and behavioral measures. Conduct post-study suspicion checks to identify participants who guessed the hypothesis. Use within-subjects designs carefully to avoid transparent condition sequencing.
Many implicit attitude measurement studies (IAT) have been criticized because participants may respond to perceived demand rather than their genuine implicit attitudes.
Use these tools to detect, analyze, or train this aspect.