🧪 This platform is in early beta. Features may change and you might encounter bugs. We appreciate your patience!
response_shift_bias
Response shift bias occurs when a change in the internal reference standard, values, or definition of a construct causes before-after comparisons on the same scale to be misleading. Patients who adapt to chronic illness may redefine what 'good quality of life' means, rating similar objective functioning higher after adjustment than before. This makes interventions appear more or less effective than they are when evaluated by subjective self-report measures.
Cancer patients rate their quality of life as 7/10 before treatment. After treatment causes partial disability, they rate it as 7/10 again — but this second rating reflects a recalibrated standard. If asked to retrospectively rate their pre-treatment quality of life from their current perspective, they now say it was actually 9/10, revealing a response shift.
A company surveys employee satisfaction before and after a major restructuring. Employees rate their work-life balance as 6/10 both times — but post-restructuring, 60-hour weeks have become the new normal, and employees have simply redefined 'balance' to fit their new reality. The identical scores mask a dramatic decline in objective conditions.
A first-year medical resident rates their stress level as 8/10 during orientation week. Two years later, after grueling overnight shifts and high-stakes decisions, they rate their stress as 6/10 — not because the job got easier, but because their benchmark for what counts as 'stressful' has fundamentally shifted. A naive comparison would falsely suggest they adapted positively.
Binary (yes/no) questions an LLM must answer to identify this aspect:
Does the study use before-after comparisons on subjective scales (e.g., quality of life, pain)?
Type: binaryCould the participants' internal reference point or definition of the construct have changed between measurements?
Type: binaryWas a retrospective pre-test (then-test) used alongside the prospective pre-test?
Type: binaryCould adaptation or recalibration explain apparent improvements in the outcome measure?
Type: binaryResponse shift bias occurs when a change in the internal reference standard, values, or definition of a construct causes before-after comparisons on the same scale to be misleading. Patients who adapt to chronic illness may redefine what 'good quality of life' means, rating similar objective functioning higher after adjustment than before. This makes interventions appear more or less effective than they are when evaluated by subjective self-report measures.
People adapt to new circumstances and recalibrate their expectations. The psychological mechanism of adaptation is real and beneficial, but it invalidates naive interpretation of longitudinal self-report data.
Use the then-test method: collect a retrospective pre-test after the post-test to capture the recalibrated pre-score. Use objective outcome measures alongside subjective ones. Apply structural equation models for response shift detection.
Quality-of-life studies in disability research and geriatric care frequently encounter response shift, with severely disabled patients reporting higher well-being than healthy observers predict.
Use these tools to detect, analyze, or train this aspect.