The process of evaluating a strategy, theory, or model by applying it to historical data.

learn more… | top users | synonyms (1)

2
votes
1answer
49 views

Up and Down days in GBPUSD and a Filter

I want to study if the odds of an up or down day in a forex pairs is 50-50. I just count the total number of up and down days in X years and compare it with the total days. The results are very ...
7
votes
0answers
162 views

Here is an approach for measuring Data Snooping; is it new?

I came up with an approach for measuring data snooping, or overfitting. My question is whether this approach was published and expanded-on already, or is it new? My approach relies on the observation ...
6
votes
0answers
568 views

Testing Valuation, Size and Momentum (proprietary factors) from 1988-2013: No evidence of driving cross-sectional returns

I am currently testing whether three proprietary factors - Valuation, Size and Momentum - explain cross-sectional returns. A sample of 3000 securities was tested using Fama-MacBeth two-pass ...
5
votes
0answers
2k views

VaR model Unconditional Coverage Tests: Is this extension of Kupiec POF test correct?

Background: Kupiec P. in 1995, published paper "Techniques for Verifying the Accuracy of Risk Management Models" on Journal of Derivatives, v3, P73-84, it's a Unconditional Coverage Tests designe for ...
4
votes
0answers
161 views

What is the most convenient data structure for backtesting a model of futures options prices?

I have an empirical model for the dynamics of futures prices in a particular market that I have implemented using a long series of the front five contracts. (I account for the roll in my model.) I ...
4
votes
0answers
274 views

Quant/Stat Factor Performance Website/Distribution?

Does anyone know of a decent quant/stat factor website, distribution(public or private) or publication that tracks performance of "many" of traditional quant/stat factors? By that I mean would show ...
3
votes
0answers
104 views

How to optimize return in a moving average crossover algorithm

Moving average crossover strategy is a widely used strategy in algo trading. Is there a way to optimize return in a moving average crossover stratergy. I have used this site to backtest MA crossover ...
3
votes
0answers
120 views

Are there canonical test cases for testing of pricing engines

Short intro: We are developing pricing engines for the calculation of market risk in a Solvency II solution, including bonds, callable bonds, cds, options, futures and so on. Are there any canonical ...
1
vote
0answers
21 views

R quantstrat backtest with dollar based position sizing

I am attempting to tweak a quantstrat based backtest but have run into an issue. The maxPos limits are share based, and I would rather use a fixed dollar amount instead. So I've tried generating a ...
1
vote
0answers
108 views

Are there any software libraries for backtesting FX algorithms against tick data?

I've read question, however it doesn't appear as if any of those libraries work for FX data. A Google search for python forex backtesting turns up this project, ...
1
vote
0answers
55 views

How to compare market values with model values after calibration?

After calibration the G2++ model for interest (with swaption volatilities), I want to statistically test the quality of the calibration by comparing market to model values. What is the best way to ...
1
vote
0answers
67 views

Adjusting for your own orders in future backtests

I was asked this question in an interview and despite thinking about it for a while, I haven't been able to come up with a good answer. Suppose you have a strategy you are running where at certain ...
1
vote
0answers
252 views

Comparing Backtests of Value-at-Risk and Expected Shortfall

My goal is to test if ES (CVaR) empirically is a better risk measure than VaR for a set of given variables (assumed underlying distribution, confidence level, sample size) for different asset classes. ...
1
vote
0answers
180 views

Backtesting benchmark / control test design

I am designing a backtesting system to test an algorithm. I'd like to have a benchmark / control test results to compare to the results of a custom algorithm. A limited "set" of stocks is selected ...
1
vote
0answers
329 views

VaR backtesting with overlapping time intervals

Of course the issue here is dependence: can it be removed or accounted for (in independence tests too, which of course would be troublesome)? There's a lot of literature on regression in this setting, ...
0
votes
0answers
33 views

What to expect when switching from backtesting to live trading?

I am back-testing my model using the closing price of 5 minute candle-bars. I am trading S&P 100 stocks. I simulate executions with the assumption I can get them 2 ticks away from the closing ...
0
votes
0answers
11 views

optimal look back period for cointegration analysis on daily prices

I'm running some cointegration tests on 2 stock pairs and was wondering, generally speaking, what would be the optimal look back period to test considering I am using daily prices and the average ...
0
votes
0answers
204 views

How to calculate returns of backtested strategy?

Lets say I have some strategy (long/short) backtested for certain period. Strategy has entries/exits only at the end of the day and may have overnight positions hold. Now I would like to compare ...