The process of evaluating a strategy, theory, or model by applying it to historical data.

learn more… | top users | synonyms (1)

6
votes
2answers
90 views

How to find funds with long history to use in backtest?

Is there a way (website/code) to find funds/etfs for a given asset class and how much data history is available (yahoo finance or other) ? It could be as simple as a list of funds by asset class and ...
3
votes
2answers
147 views

How to get historical fundamental data in Bloomberg suitable for backtesting?

I'm trying to retrieve historical stocks fundamental data from Bloomberg to backtest some quant ideas. I'm having trouble to find the correct point in time the data was available. For instance, the ...
5
votes
1answer
239 views

Up and Down days in GBPUSD and a Filter

I want to study if the odds of an up or down day in a forex pairs is 50-50. I just count the total number of up and down days in X years and compare it with the total days. The results are very ...
2
votes
1answer
85 views

Simple Moving Average Backtest: Cumulative Return too high

I apologize if this is way too basic a question, but I'm an absolute beginner to trading and am in the process of learning the fundamentals. Currently I'm trying to model a (10-day) SMA backtest in ...
2
votes
1answer
95 views

ES not elicitable

Expected Shortfall is not elicitable as some papers have pointed out. That simply means that there is no scoring function that elicits ES. My question is, does this imply that Expected Shortfall ...
1
vote
1answer
34 views

Writing an Options Strategy Backtester

I've been doing some digging, and this question has been asked many times in various forms over the years - Backtesting Options Strategies in R Are there any good tools for backtesting options ...
1
vote
1answer
34 views

how to choose a price adjustment, a roll date and a data center for my trading strategy?

I have many doubts about Which roll date and price adjustment should I use. I need to backtest like 50 diferents futures. 6 index(mini sp500, Nikkei 225…), 10 Agriculture (soybean, Oat, Corn….),3 ...
9
votes
0answers
698 views

Testing Valuation, Size and Momentum (proprietary factors) from 1988-2013: No evidence of driving cross-sectional returns

I am currently testing whether three proprietary factors - Valuation, Size and Momentum - explain cross-sectional returns. A sample of 3000 securities was tested using Fama-MacBeth two-pass ...
8
votes
0answers
192 views

Here is an approach for measuring Data Snooping; is it new?

I came up with an approach for measuring data snooping, or overfitting. My question is whether this approach was published and expanded-on already, or is it new? My approach relies on the observation ...
7
votes
0answers
210 views

What is the most convenient data structure for backtesting a model of futures options prices?

I have an empirical model for the dynamics of futures prices in a particular market that I have implemented using a long series of the front five contracts. (I account for the roll in my model.) I ...
7
votes
0answers
2k views

VaR model Unconditional Coverage Tests: Is this extension of Kupiec POF test correct?

Background: Kupiec P. in 1995, published paper "Techniques for Verifying the Accuracy of Risk Management Models" on Journal of Derivatives, v3, P73-84, it's a Unconditional Coverage Tests designe for ...
4
votes
0answers
305 views

Quant/Stat Factor Performance Website/Distribution?

Does anyone know of a decent quant/stat factor website, distribution(public or private) or publication that tracks performance of "many" of traditional quant/stat factors? By that I mean would show ...
4
votes
0answers
122 views

Are there canonical test cases for testing of pricing engines

Short intro: We are developing pricing engines for the calculation of market risk in a Solvency II solution, including bonds, callable bonds, cds, options, futures and so on. Are there any canonical ...
3
votes
0answers
54 views

'GARCH - extreme value theory - copula' approach to estimate risk measures in R

I'm reading about this approach of using GARCH-EVT-copula methodology to separate univariate and joint estimation and then estimate for example VaR and ES. I wanted to try something similar, but my ...
3
votes
0answers
61 views

Trading signal strength: [-1 to 1] or [predicted return]?

In the context of a backtesting engine, is it better to have strategy generate trade signals in the range from -1 to 1 or as exact predicted returns (e.g. -12% or 26%). The difference lies in how to ...
3
votes
0answers
90 views

Strategy Testing

Firstly I am a newbie so I will apologise in advance if this is in the wrong forum. My question concerns testing for an equity trading strategy and I would appreciate any comments as to whether my ...
3
votes
0answers
391 views

VaR backtesting with overlapping time intervals

Of course the issue here is dependence: can it be removed or accounted for (in independence tests too, which of course would be troublesome)? There's a lot of literature on regression in this setting, ...
2
votes
0answers
32 views

Significance testing of average returns from Sharpe ratio

I'm aware that one way to do significance testing on a strategy is based on the sampling distribution of its Sharpe (see, e.g., Lo, 2002 and Opdyke, 2008). However, it appears to me that there's ...
2
votes
0answers
106 views

R quantstrat backtest with dollar based position sizing

I am attempting to tweak a quantstrat based backtest but have run into an issue. The maxPos limits are share based, and I would rather use a fixed dollar amount instead. So I've tried generating a ...
2
votes
0answers
172 views

Are there any software libraries for backtesting FX algorithms against tick data?

I've read question, however it doesn't appear as if any of those libraries work for FX data. A Google search for python forex backtesting turns up this project, ...
2
votes
0answers
71 views

How to compare market values with model values after calibration?

After calibration the G2++ model for interest (with swaption volatilities), I want to statistically test the quality of the calibration by comparing market to model values. What is the best way to ...
2
votes
0answers
81 views

Adjusting for your own orders in future backtests

I was asked this question in an interview and despite thinking about it for a while, I haven't been able to come up with a good answer. Suppose you have a strategy you are running where at certain ...
1
vote
0answers
18 views

Relationship between in-sample and out-sample periods length

I have two general questions regarding "in-sample fitting vs. out-of-sample backtesting" kind of analyses. Is there any relationship between the length of the data collected for in-sample fitting ($a$)...
1
vote
0answers
38 views

How to backtest strategy in portfolio of stocks using SIT R?

I am creating and testing strategies in R code and using systemic investor toolbox(SIT) package as the backtesting tool. I copied a SIT backtesting code from a website and made small changes to make ...
1
vote
0answers
54 views

Backtesting Long/Short Market Neutral Z-Score Strategy with Custom Factors and Custom Stock Universe

So I've managed to backtest simple strategies, like MA, RSI and some fundamental ones (P/E ratios etc) but Im stuck at my last strategy. Here is some information: Tools: Excel and Python (also a ...
1
vote
0answers
19 views

Should the number of Markowitz Optimization steps be counted as backtest trials?

I'm backtesting a strategy that involves monthly investments in a few stocks out of a given set, that is, each month some of the stocks are shortlisted from an index and a long position is taken in ...
1
vote
0answers
64 views

Cointegration for forex using ARMA model to forecast the spread

I am working on an automatized quantitative strategy that use cointegration in Forex. I am backtesting this strategy in Python. Please see below the python file: https://drive.google.com/file/d/...
1
vote
0answers
41 views

Proper Definition of Backtesting Parameter

Currently I'm trying to test the efficacy of a tail-hedging strategy in which an investor goes long in an index and correspondingly buys 1-month OTM put options. For practical reasons, the options ...
1
vote
0answers
22 views

Making apriori Statements on VaR Backtests with a Garch Modelled VaR

so I want to find out, if its possible to find out for any backtest for the Value at Risk(Kupics POF or Christophersen's Markov Test), if it is possible to make apriori Statements on Testing results ( ...
1
vote
0answers
147 views

How to backtest Value at Risk Models using Conditional and Unconditional tests?

I am trying to carry out backtesting on a number of Value at Risk figures i obtained using var/covar, historical, and monte carlo simulation. The two methods im using are the Kupiec test (...
1
vote
0answers
270 views

Comparing Backtests of Value-at-Risk and Expected Shortfall

My goal is to test if ES (CVaR) empirically is a better risk measure than VaR for a set of given variables (assumed underlying distribution, confidence level, sample size) for different asset classes. ...
1
vote
0answers
188 views

Backtesting benchmark / control test design

I am designing a backtesting system to test an algorithm. I'd like to have a benchmark / control test results to compare to the results of a custom algorithm. A limited "set" of stocks is selected ...
0
votes
0answers
18 views

Using the univariate regression coefficient to calculate cumulative return - does it make sense?

When testing a stand-alone signal usually one of the simple tests I do is a long-short equal-weight strategy to see how the wealth chart looks like. Going through my predecessor's code I see ...
0
votes
0answers
19 views

Value at Risk Backtest type 2 error

I am wondering why in the most popular tests(Kupiec's POF, Christoffersen, the Null hypothesis is "our model is accurate". If we set our null hypothesis that way, we only have a decent result if we ...
0
votes
0answers
30 views

Kfold cross validation: how to handle hold-out periods

I want to backtest a strategy using K-fold cross validation. Assume I have a period of 300 days in my backtest. I divide it into 30 folds of 10 days each. On day 1 of a fold, I enter a trade, and ...
0
votes
0answers
10 views

Video Metadata Backtest

If you were to Backtest data extracted from video feeds, let's say for commodities. How many years/hours of video would you desire? The video repository is currently harvested going back 5 years and ...
0
votes
0answers
77 views

backtest asset allocation strategies

I've searched the site but haven't found an easy way to backtest my personal portfolio allocations. Suppose I want to know the total return for the following portfolio from Jan 1, 2009 to Dec 31, 2014:...
0
votes
0answers
24 views

Video Analysis Platform

I own a data analysis company which is currently bulk extracting metadata from historical market video and audio files, and creating alternative/historical datasets around commodities, S&P 500 ...
0
votes
0answers
7 views

Is Market OPG an efficient means of entering positions at historic daily open prices?

This question pertains to backtesting a strategy against historic daily data. If a strategy is devised using such data, is Market OPG a reasonable way to enter positions? Expanding, the question is ...
0
votes
0answers
46 views

optimal look back period for cointegration analysis on daily prices

I'm running some cointegration tests on 2 stock pairs and was wondering, generally speaking, what would be the optimal look back period to test considering I am using daily prices and the average ...
0
votes
0answers
394 views

How to calculate returns of backtested strategy?

Lets say I have some strategy (long/short) backtested for certain period. Strategy has entries/exits only at the end of the day and may have overnight positions hold. Now I would like to compare ...