The process of evaluating a strategy, theory, or model by applying it to historical data.

learn more… | top users | synonyms (1)

5
votes
2answers
81 views

How to find funds with long history to use in backtest?

Is there a way (website/code) to find funds/etfs for a given asset class and how much data history is available (yahoo finance or other) ? It could be as simple as a list of funds by asset class and ...
5
votes
1answer
221 views

Up and Down days in GBPUSD and a Filter

I want to study if the odds of an up or down day in a forex pairs is 50-50. I just count the total number of up and down days in X years and compare it with the total days. The results are very ...
2
votes
1answer
24 views

Simple Moving Average Backtest: Cumulative Return too high

I apologize if this is way too basic a question, but I'm an absolute beginner to trading and am in the process of learning the fundamentals. Currently I'm trying to model a (10-day) SMA backtest in ...
1
vote
1answer
71 views

ES not elicitable

Expected Shortfall is not elicitable as some papers have pointed out. That simply means that there is no scoring function that elicits ES. My question is, does this imply that Expected Shortfall ...
1
vote
1answer
27 views

how to choose a price adjustment, a roll date and a data center for my trading strategy?

I have many doubts about Which roll date and price adjustment should I use. I need to backtest like 50 diferents futures. 6 index(mini sp500, Nikkei 225…), 10 Agriculture (soybean, Oat, Corn….),3 ...
8
votes
0answers
190 views

Here is an approach for measuring Data Snooping; is it new?

I came up with an approach for measuring data snooping, or overfitting. My question is whether this approach was published and expanded-on already, or is it new? My approach relies on the observation ...
8
votes
0answers
673 views

Testing Valuation, Size and Momentum (proprietary factors) from 1988-2013: No evidence of driving cross-sectional returns

I am currently testing whether three proprietary factors - Valuation, Size and Momentum - explain cross-sectional returns. A sample of 3000 securities was tested using Fama-MacBeth two-pass ...
6
votes
0answers
202 views

What is the most convenient data structure for backtesting a model of futures options prices?

I have an empirical model for the dynamics of futures prices in a particular market that I have implemented using a long series of the front five contracts. (I account for the roll in my model.) I ...
6
votes
0answers
2k views

VaR model Unconditional Coverage Tests: Is this extension of Kupiec POF test correct?

Background: Kupiec P. in 1995, published paper "Techniques for Verifying the Accuracy of Risk Management Models" on Journal of Derivatives, v3, P73-84, it's a Unconditional Coverage Tests designe for ...
4
votes
0answers
301 views

Quant/Stat Factor Performance Website/Distribution?

Does anyone know of a decent quant/stat factor website, distribution(public or private) or publication that tracks performance of "many" of traditional quant/stat factors? By that I mean would show ...
4
votes
0answers
122 views

Are there canonical test cases for testing of pricing engines

Short intro: We are developing pricing engines for the calculation of market risk in a Solvency II solution, including bonds, callable bonds, cds, options, futures and so on. Are there any canonical ...
3
votes
0answers
82 views

Strategy Testing

Firstly I am a newbie so I will apologise in advance if this is in the wrong forum. My question concerns testing for an equity trading strategy and I would appreciate any comments as to whether my ...
3
votes
0answers
384 views

VaR backtesting with overlapping time intervals

Of course the issue here is dependence: can it be removed or accounted for (in independence tests too, which of course would be troublesome)? There's a lot of literature on regression in this setting, ...
2
votes
0answers
28 views

Significance testing of average returns from Sharpe ratio

I'm aware that one way to do significance testing on a strategy is based on the sampling distribution of its Sharpe (see, e.g., Lo, 2002 and Opdyke, 2008). However, it appears to me that there's ...
2
votes
0answers
97 views

R quantstrat backtest with dollar based position sizing

I am attempting to tweak a quantstrat based backtest but have run into an issue. The maxPos limits are share based, and I would rather use a fixed dollar amount instead. So I've tried generating a ...
2
votes
0answers
156 views

Are there any software libraries for backtesting FX algorithms against tick data?

I've read question, however it doesn't appear as if any of those libraries work for FX data. A Google search for python forex backtesting turns up this project, ...
2
votes
0answers
71 views

How to compare market values with model values after calibration?

After calibration the G2++ model for interest (with swaption volatilities), I want to statistically test the quality of the calibration by comparing market to model values. What is the best way to ...
2
votes
0answers
75 views

Adjusting for your own orders in future backtests

I was asked this question in an interview and despite thinking about it for a while, I haven't been able to come up with a good answer. Suppose you have a strategy you are running where at certain ...
1
vote
0answers
25 views

Bloomberg Historical Fundamental Data - Point in time

I'm trying to retrieve historical stocks fundamental data from Bloomberg to backtest some quant ideas. I'm having trouble to find the correct point in time the data was available. For instance, the ...
1
vote
0answers
15 views

Making apriori Statements on VaR Backtests with a Garch Modelled VaR

so I want to find out, if its possible to find out for any backtest for the Value at Risk(Kupics POF or Christophersen's Markov Test), if it is possible to make apriori Statements on Testing results ( ...
1
vote
0answers
105 views

How to backtest Value at Risk Models using Conditional and Unconditional tests?

I am trying to carry out backtesting on a number of Value at Risk figures i obtained using var/covar, historical, and monte carlo simulation. The two methods im using are the Kupiec test ...
1
vote
0answers
270 views

Comparing Backtests of Value-at-Risk and Expected Shortfall

My goal is to test if ES (CVaR) empirically is a better risk measure than VaR for a set of given variables (assumed underlying distribution, confidence level, sample size) for different asset classes. ...
1
vote
0answers
186 views

Backtesting benchmark / control test design

I am designing a backtesting system to test an algorithm. I'd like to have a benchmark / control test results to compare to the results of a custom algorithm. A limited "set" of stocks is selected ...
0
votes
0answers
12 views

Value at Risk Backtest type 2 error

I am wondering why in the most popular tests(Kupiec's POF, Christoffersen, the Null hypothesis is "our model is accurate". If we set our null hypothesis that way, we only have a decent result if we ...
0
votes
0answers
20 views

Kfold cross validation: how to handle hold-out periods

I want to backtest a strategy using K-fold cross validation. Assume I have a period of 300 days in my backtest. I divide it into 30 folds of 10 days each. On day 1 of a fold, I enter a trade, and ...
0
votes
0answers
8 views

Video Metadata Backtest

If you were to Backtest data extracted from video feeds, let's say for commodities. How many years/hours of video would you desire? The video repository is currently harvested going back 5 years and ...
0
votes
0answers
48 views

backtest asset allocation strategies

I've searched the site but haven't found an easy way to backtest my personal portfolio allocations. Suppose I want to know the total return for the following portfolio from Jan 1, 2009 to Dec 31, ...
0
votes
0answers
22 views

Video Analysis Platform

I own a data analysis company which is currently bulk extracting metadata from historical market video and audio files, and creating alternative/historical datasets around commodities, S&P 500 ...
0
votes
0answers
7 views

Is Market OPG an efficient means of entering positions at historic daily open prices?

This question pertains to backtesting a strategy against historic daily data. If a strategy is devised using such data, is Market OPG a reasonable way to enter positions? Expanding, the question is ...
0
votes
0answers
44 views

optimal look back period for cointegration analysis on daily prices

I'm running some cointegration tests on 2 stock pairs and was wondering, generally speaking, what would be the optimal look back period to test considering I am using daily prices and the average ...
0
votes
0answers
367 views

How to calculate returns of backtested strategy?

Lets say I have some strategy (long/short) backtested for certain period. Strategy has entries/exits only at the end of the day and may have overnight positions hold. Now I would like to compare ...