Essential Guide: What to Look for in Backtesting Signal Services Before You Subscribe

Essential criteria to guide your subscription to backtesting signal services.

Image source: 6 Best Practices for Backtesting Trading Strategies

Before subscribing to a backtesting‑driven signal service, demand clear evidence that the service is robust, transparent, and realistic—not just a pretty equity curve. Below are the key things to insist on.¹^{, 2}

1. Transparent methodology and rules

Ask for:

A written, non‑marketing description of the signal logic (entry/exit, filters, position sizing, risk management).²^{, 3}
Exact timeframes, asset classes, and conditions under which the strategy was tested.⁴^{, 5}

If the provider refuses to share at least a schematic rule set, treat that as a red flag.¹

2. Quality and scope of the backtest

Require:

Sufficient history: several years of data, covering multiple market regimes (trending, ranging, crisis).⁵^{, 2}
A clean, replicable dataset: no obvious survivorship bias, and adjustments for splits, dividends, or variable spreads/commissions.³^{, 6}

Ideally they should show both in‑sample and out‑of‑sample (or walk‑forward) results so you can see whether performance degrades when the model is constrained.²^{, 5}

3. Realistic transaction costs and slippage

Demand explicit inclusion of:

Commissions, spreads, and fees appropriate to your broker.⁷^{, 2}
Slippage assumptions (e.g., 0.1–0.5% per trade) and any impact‑modeling for larger positions.⁶^{, 2}

If the backtest assumes zero costs or perfect fills, ask how the equity curve changes when typical real‑world frictions are added.⁵^{, 2}

4. Risk and drawdown metrics

Before paying, insist on seeing:

Drawdown statistics (max drawdown, average drawdown, drawdown duration) and stress tests (Monte Carlo or walk‑forward).³^{, 2}
Metrics like Sharpe/Sortino ratio, win rate, average gain/loss, and R‑multiple per trade, not just “X% return.”⁸^{, 5}

If the provider only advertises raw returns without drawdown context, assume they’re hiding volatility.⁹^{, 1}

5. Live‑vs‑backtest consistency

Ask for:

A meaningful period of live trading history (ideally 3–6 months or more) that you can compare to the backtest.¹⁰^{, 9}
Daily or weekly reporting of realized signals vs. what the backtest would have produced, including execution timestamps and fill prices if available.¹¹^{, 5}

If live results deviate sharply from the backtest, either the model is unstable, the market regime changed, or the backtest was over‑optimized.⁶^{, 2}

6. Access to a track record or sample

Before you pay, request:

A free or trial‑size sample of recent signals (e.g., 30–60 days) you can forward‑test or paper‑trade yourself.¹²^{, 11}
Verified third‑party track records (MyFxBook, FXBlue, broker‑mirrored accounts) rather than screenshots from a private platform.⁹^{, 1}

If they can’t provide a verifiable, time‑stamped track record, you’re effectively buying faith, not a tested system.¹^{, 9}

If you describe the type of markets you trade (Forex, stocks, crypto, etc.) and your typical position size, I can help you draft a short checklist/questionnaire you can send directly to signal providers.