Start freeSign in
Research/Glossary/Pre-registration

Pre-registration

Reference

Pre-registration means writing down a hypothesis, the dataset, the test design, and the decision rules before reviewing the results.

Pre-registration means writing down a hypothesis, the dataset, the test design, and the decision rules before reviewing the results. In quantitative research, this creates a record of what was intended to be tested and how success or failure will be judged. The practical effect is to separate genuine hypothesis testing from quiet retrofitting after the fact.

Quiet retrofitting happens when a researcher adjusts the story, parameters, filters, or evaluation criteria to fit results that have already been observed. That process can make a strategy look more convincing in-sample than it really is. Sonar describes the broader research-to-publishing workflow as a way to preserve traceability from research through publication, which supports the idea that documented, staged research reduces the room for hidden changes between hypothesis and reported conclusion [1].

The mechanism is straightforward. When the hypothesis and test plan are fixed in advance, the researcher has less freedom to:

  • change the target after seeing outcomes
  • swap metrics until one looks favorable
  • redefine the sample window to improve the appearance of fit
  • add or remove rules without recording that the design changed

That reduction in researcher degrees of freedom matters because overfitting is often the result of repeated untracked adjustments. Sonar's backtest overfitting audit tool is built around detecting whether a research process has likely extracted noise rather than signal from historical data [2]. A pre-registered workflow does not guarantee validity, but it narrows the path by which a model can be tuned to incidental historical patterns.

This is also where evaluation metrics become more meaningful. Sonar's glossary entry on the deflated Sharpe ratio explains that the metric adjusts observed Sharpe ratios for multiple testing and non-normal returns, making it more conservative than a plain Sharpe ratio when many trials or specifications have been explored [3]. Pre-registration complements that logic. If the number of tested variations is controlled and documented in advance, then the adjustment for selection effects is grounded in a clearer accounting of what was actually tried. In that sense, pre-registration and the deflated Sharpe ratio address the same core problem from different angles: one constrains the research process, and the other discounts performance statistics that may be inflated by repeated searching [3].

For systematic researchers, the main benefit is not rigidity for its own sake. It is cleaner inference. A pre-registered design helps distinguish between three different activities that are often blurred together:

  • exploration, where ideas are generated
  • confirmation, where a specific hypothesis is tested
  • reporting, where methods and outcomes are documented

When these stages are mixed, overfitting risk rises because the final reported strategy may reflect many invisible decisions made after results were known. When the stages are separated and recorded, it becomes easier to judge whether apparent predictive power came from a true prior thesis or from iterative fitting.

So the strongest supported conclusion is this: pre-registration is a process control that can reduce the opportunity for quiet retrofitting, and that should reduce one important pathway to overfitting, especially when paired with tools that audit overfitting risk and metrics that adjust for multiple testing [1][2][3].

Covered in depth in the From research to publishing pillar hub.

Apply this and the related checks to your own results with the Backtest Overfitting Audit.Open the audit
ShareXLinkedInFacebookEmail