Interviewer Bias

Also Known As: Interview Bias Questioner Bias

Statistical Error ID: interviewer_bias

Definition

Interviewer bias occurs when the person conducting interviews systematically influences responses through their questioning style, body language, tone, or probing patterns. Interviewers who know the study hypothesis or participants' group membership may unconsciously ask leading questions, probe more deeply for expected answers, or interpret ambiguous responses in the anticipated direction.

Examples

In a case-control study of childhood leukemia, interviewers who know which children have leukemia probe mothers more intensively about environmental exposures, chemical use, and household products. Mothers of healthy children receive briefer, less detailed questioning.

A political pollster who personally supports stricter gun control slightly pauses and nods when respondents express pro-regulation views, and moves quickly past pro-gun responses. Over hundreds of interviews, this subtle reinforcement nudges the reported distribution of opinions toward stricter regulation.

During exit interviews with employees who are leaving a company, the HR manager — who designed the onboarding program — asks departing staff about their experience. Employees sense the manager's personal investment and soften their criticisms of onboarding, leading the company to underestimate how much poor onboarding contributed to turnover.

Verification Steps

Verification Steps

Binary yes/no questions that an AI must answer to detect a reasoning pattern in a text.

Each of the 452 aspects has verification steps — simple yes/no questions designed to systematically detect whether a pattern appears in a text. For ad hominem: "Does the argument attack a person rather than their claim?" For false dichotomy: "Are only two options presented when more exist?" This ensures consistent, reproducible analysis.

View in glossary →

Binary (yes/no) questions an LLM must answer to identify this aspect:

1

Did interviewers know the hypothesis or participants' group assignment?
Type: binary
2

Could the interviewer's behavior, tone, or probing have differed between groups?
Type: binary
3

Were interviews conducted using standardized scripts and protocols?
Type: binary
4

Were multiple interviewers used, and was inter-interviewer consistency assessed?
Type: binary

Description

Why It Works

Human interaction is subtly influenced by expectations. An interviewer's tone, facial expression, follow-up questions, and level of persistence all signal what kind of answer is desired. Respondents pick up on these cues and adjust their responses accordingly, often without either party being aware.

How to Counter

Blind interviewers to the study hypothesis and participants' group status. Use structured interview protocols with predetermined questions and probes. Record interviews for quality assurance. Use self-administered questionnaires where feasible.

Also Known As

Interview Bias Questioner Bias

Real-World Context

Police interrogation research has documented how interviewer expectations shape suspect responses. Officers who believe a suspect is guilty use more confrontational techniques and interpret ambiguous statements as evidence of guilt, contributing to false confessions.