HARKing (Hypothesizing After Results are Known) — When Logic Wears a Disguise

HARKing is the practice of presenting a hypothesis that was developed or refined after examining the data as though it had been formulated before data collection. This transforms exploratory analysis into what appears to be confirmatory research, creating a false impression that a specific prediction was confirmed. HARKing inflates the apparent evidential value of findings because post-hoc hypotheses are fitted to the data and therefore almost guaranteed to be supported by it.

Also known as: Post-hoc hypothesis revision, Retrospective hypothesizing

How It Works

Readers cannot tell from a published paper whether a hypothesis was formulated before or after data analysis. The narrative format of academic papers naturally lends itself to coherent storytelling, and presenting a clean prediction-confirmation story is more compelling and publishable than reporting exploratory findings.

A Classic Example

A researcher studies the effect of a drug on 20 health outcomes. Only the effect on blood pressure is statistically significant. The published paper presents a focused hypothesis about blood pressure, with no mention of the other 19 outcomes tested, making it appear as though the drug's blood pressure effect was the predicted finding all along.

More Examples

A marketing team runs an A/B test on five different ad designs and measures click-through rates, purchase conversions, and time-on-page. Only one metric — time-on-page — differs significantly for one ad variant. The final report is presented to leadership with the confident headline 'We hypothesized that Ad Variant C would boost user engagement,' framing a post-hoc observation as a planned prediction.

A sociologist collects survey data on 30 demographic and attitudinal variables, then runs correlations across all of them. She notices that people who own houseplants report slightly higher life satisfaction. She writes up the finding with an introduction citing theories of biophilia and human-nature connection, presenting it as a theoretically motivated hypothesis rather than a pattern she stumbled upon while data-mining.

Where You See This in the Wild

Widespread across psychology, biomedical research, and economics. The replication crisis revealed that many published findings were likely HARKed, contributing to inflated effect sizes and failure to replicate.

How to Spot and Counter It

Pre-register hypotheses and analysis plans before data collection. Distinguish clearly between confirmatory and exploratory analyses in publications. Require access to pre-registration records during peer review. Value and publish exploratory research as such rather than disguising it as confirmatory.

The Takeaway

The HARKing (Hypothesizing After Results are Known) is one of those reasoning errors that sounds perfectly logical at first glance. That's what makes it dangerous — it wears the costume of valid reasoning while smuggling in a broken conclusion. The best defense? Slow down and ask: does this conclusion actually follow from these premises, or am I just connecting dots that happen to be near each other?

Next time someone presents you with an argument that "just makes sense," check the structure. The feeling of logic is not the same as logic itself.