The process of evaluating a strategy, theory, or model by applying it to historical data.

learn more… | top users | synonyms (1)

5
votes
0answers
1k views

VaR model Unconditional Coverage Tests: Is this extension of Kupiec POF test correct?

Background: Kupiec P. in 1995, published paper "Techniques for Verifying the Accuracy of Risk Management Models" on Journal of Derivatives, v3, P73-84, it's a Unconditional Coverage Tests designe for ...
4
votes
0answers
141 views

What is the most convenient data structure for backtesting a model of futures options prices?

I have an empirical model for the dynamics of futures prices in a particular market that I have implemented using a long series of the front five contracts. (I account for the roll in my model.) I ...
4
votes
0answers
517 views

Testing Valuation, Size and Momentum (proprietary factors) from 1988-2013: No evidence of driving cross-sectional returns

I am currently testing whether three proprietary factors - Valuation, Size and Momentum - explain cross-sectional returns. A sample of 3000 securities was tested using Fama-MacBeth two-pass ...
4
votes
0answers
257 views

Quant/Stat Factor Performance Website/Distribution?

Does anyone know of a decent quant/stat factor website, distribution(public or private) or publication that tracks performance of "many" of traditional quant/stat factors? By that I mean would show ...
3
votes
0answers
119 views

Are there canonical test cases for testing of pricing engines

Short intro: We are developing pricing engines for the calculation of market risk in a Solvency II solution, including bonds, callable bonds, cds, options, futures and so on. Are there any canonical ...
2
votes
0answers
50 views

Methodology for handling short american options in a back test

Given that an American option can be exercised at any time, how does one handle algorithmically selling an American option in a back test? I am not sure what the best practice is to simulate the early ...
1
vote
0answers
50 views

Here is an approach for measuring Data Snooping; is it new?

I came up with an approach for measuring data snooping, or overfitting. My question is whether this approach was published and expanded-on already, or is it new? My approach relies on the observation ...
1
vote
0answers
47 views

How to compare market values with model values after calibration?

After calibration the G2++ model for interest (with swaption volatilities), I want to statistically test the quality of the calibration by comparing market to model values. What is the best way to ...
1
vote
0answers
59 views

Adjusting for your own orders in future backtests

I was asked this question in an interview and despite thinking about it for a while, I haven't been able to come up with a good answer. Suppose you have a strategy you are running where at certain ...
1
vote
0answers
239 views

Comparing Backtests of Value-at-Risk and Expected Shortfall

My goal is to test if ES (CVaR) empirically is a better risk measure than VaR for a set of given variables (assumed underlying distribution, confidence level, sample size) for different asset classes. ...
1
vote
0answers
173 views

Backtesting benchmark / control test design

I am designing a backtesting system to test an algorithm. I'd like to have a benchmark / control test results to compare to the results of a custom algorithm. A limited "set" of stocks is selected ...
1
vote
0answers
304 views

VaR backtesting with overlapping time intervals

Of course the issue here is dependence: can it be removed or accounted for (in independence tests too, which of course would be troublesome)? There's a lot of literature on regression in this setting, ...
0
votes
0answers
78 views

Are there any software libraries for backtesting FX algorithms against tick data?

I've read question, however it doesn't appear as if any of those libraries work for FX data. A Google search for python forex backtesting turns up this project, ...
0
votes
0answers
161 views

How to calculate returns of backtested strategy?

Lets say I have some strategy (long/short) backtested for certain period. Strategy has entries/exits only at the end of the day and may have overnight positions hold. Now I would like to compare ...
-1
votes
0answers
46 views

Is the Altman Z-Score broken?

When I try to predict future returns with with the Altman Z score, it fails. That would likely not be the case if it predicted bankruptcy well (e.g. the Piotroski F score). It seems to predict ...