function Methodology({ go }) { const wide = useWide(); const Section = ({ label, children }) => (
{children}
); const Callout = ({ children }) => (Most published backtests are not backtests. They are curve fits — strategies optimized against the same data they will be judged on. The parameters look good because the researcher kept adjusting them until they did. The result is a strategy that worked in the past because it was designed to work in the past.
This is not dishonesty. It is the default outcome of any optimization process applied to a finite dataset. When you fit a model to data and then measure it on that same data, you are measuring how well you memorized the data, not how well the model generalizes to new observations.
In trading, this means the strategy you deploy in live markets will underperform its backtest — often substantially. The gap between reported and live performance is almost entirely explained by overfitting.
Walk-forward validation is the discipline of separating optimization from evaluation. It is the closest thing systematic traders have to an honest test.
We divide historical data into rolling windows. Each window has two parts: an in-sample period where parameters are optimized, and an out-of-sample period where the optimized parameters are run blind — no further adjustment allowed. The window then steps forward and the process repeats.
A strategy that survives this process has demonstrated that its parameters generalize. It has not merely memorized its training data. That is a low bar — most strategies fail it — but it is the minimum threshold for taking a system seriously before allocating capital to it.
Every strategy published at Walkforward must meet the following criteria on its out-of-sample results:
Crypto price data comes from Binance via their public REST API. TradFi assets (S&P 500, Nasdaq, Gold, Silver) come from Yahoo Finance. All price data is daily close. We do not use tick data or order book data for strategy backtesting — daily bars have sufficient resolution for the types of trend-following and mean-reversion systems we test, and the data quality is materially more reliable.
Our backtester is open to members. The parameters, the data, and the full equity curves are visible. We do not publish conclusions without showing the work.
Walk-forward validation reduces overfitting — it does not eliminate it. A strategy can pass a walk-forward test and still fail in live trading due to execution differences, regime changes, or bad luck in the test window. We document these risks for every strategy we publish.
The size of the test window matters. A 1-year out-of-sample period that happened to contain a strong trend will inflate results for a trend-following strategy. We check for this by reviewing the distribution across all out-of-sample windows, not just the aggregate.