The process of evaluating a strategy, theory, or model by applying it to historical data.

learn more… | top users | synonyms (1)

-1
votes
0answers
32 views

Is the Altman Z-Score broken?

When I try to predict future returns with with the Altman Z score, it fails. That would likely not be the case if it predicted bankruptcy well (e.g. the Piotroski F score, or the Baneish M score). ...
1
vote
1answer
337 views

How to fully replicate ADX + DI Indicators in Excel?

For black box testing, I was hoping that I could replicate the ADX + DI+ and DI- indicators that are provided in trading platforms such as ThinkOrSwim, ScottradeElite etc. However, I noticed that ...
1
vote
1answer
54 views

Limits on Short selling

When back testing an algorithm that relies upon short selling certain stocks, how to limit the short selling so that the back-test results still remain reliable? What kind of controls are generally ...
4
votes
2answers
638 views

Volatility of a rolling window strategy

What methods can be applied to determine the volatility of strategy using a rolling window? Using normal standard deviation would bias the results as the returns will be highly correlated. Although, ...
1
vote
1answer
83 views

Calculation of Returns and Risk Metrics for L/S Portfolio

I am trying to build a test for a long/short portfolio. I am aiming for market neutral and have put together a long portfolio as well as a short portfolio (see below). However, I am not sure if I am ...
3
votes
1answer
90 views

Question about historical volatility ranking

I have seen this strategy example, which uses garch in a regime switching context: https://systematicinvestor.wordpress.com/2012/01/06/trading-using-garch-volatility-forecast/ The author classifies ...
2
votes
0answers
50 views

Methodology for handling short american options in a back test

Given that an American option can be exercised at any time, how does one handle algorithmically selling an American option in a back test? I am not sure what the best practice is to simulate the early ...
3
votes
1answer
321 views

How do you estimate the capacity of a strategy from historical data?

What are some good ways to estimate the capacity of a strategy from historical data (including full market depth)? Obviously, a naive approach is that you want the strategy's returns to exceed its ...
3
votes
1answer
147 views

Backtesting on historical option data

I have downloaded some daily historical option data for a timespan of 10 years and want to perform trading backtests with them. Data are European index options, on ODAX. My question is about realistic ...
13
votes
4answers
8k views

Are there any good tools for back testing options strategies?

There are all kinds of tools for backtesting linear instruments (like stocks or stock indices). It is a completely different story when it comes to option strategies. Most of the tools used are ...
1
vote
0answers
50 views

Here is an approach for measuring Data Snooping; is it new?

I came up with an approach for measuring data snooping, or overfitting. My question is whether this approach was published and expanded-on already, or is it new? My approach relies on the observation ...
0
votes
1answer
52 views

Daily or weekly data?

I am trying to test a strategy but do not know if I should use daily or weekly data? I have tried researching this & have found that daily data will bring " too much " noise compared to lower ...
1
vote
1answer
87 views

Simulating Stock's close, high and low prices

I am testing a model in which I need to simulate closing, high and low prices (i.e. 3 dimensions of prices) of any given stock. Using the simple Geometric Brownion Motion equation I can easily ...
3
votes
1answer
84 views

How to compute daily compounded backtest returns closer to real-world results?

I often run quick tests of trading strategies in my analytics suites by: multiplying a vector of signal (lagged, {-1,0,1}) with a time series of daily percentage returns doing a cumulative product ...
3
votes
1answer
113 views

Overlapping Value-at-Risk Backtest Data an Issue?

My understanding of VaR model back testing is thus: ~~ t: Calculate daily VaR using look back data over n past days t+1: Compare daily return against VaR, record breach if one occurred, repeat ...
5
votes
3answers
724 views

Expected Shortfall (CVaR) Backtesting

I am writing my thesis on VaR and ES risk measurements and have encountered some issues with how to best test the accuracy of ES estimates. My understanding of the topic is that backtesting ES ...
0
votes
0answers
78 views

Are there any software libraries for backtesting FX algorithms against tick data?

I've read question, however it doesn't appear as if any of those libraries work for FX data. A Google search for python forex backtesting turns up this project, ...
3
votes
1answer
378 views

Learn backtesting using MATLAB

What are some good ressources (books, articles, ...) to learn backtesting of investment strategies using MATLAB ? It can be strategies related to fixed-income, equities, derivatives, ... whatever. ...
0
votes
1answer
75 views

Backtesting software with custom data input

I was considering to develop a custom backtesting platform for myself. However, I see that it would require some significant time and effort, and the result might not be as initially expected. So I ...
1
vote
1answer
528 views

Backtesting with fundamentals

Recently I've read some books about quantative approach to fundamental investing: - What works on Wall Street - James O'Shaughnessy - Quantitative Value - Wesley Gray, Tobias Carlisle - Quantitative ...
1
vote
0answers
47 views

How to compare market values with model values after calibration?

After calibration the G2++ model for interest (with swaption volatilities), I want to statistically test the quality of the calibration by comparing market to model values. What is the best way to ...
1
vote
0answers
59 views

Adjusting for your own orders in future backtests

I was asked this question in an interview and despite thinking about it for a while, I haven't been able to come up with a good answer. Suppose you have a strategy you are running where at certain ...
0
votes
2answers
116 views

Long/Short Backtesting Set up

I am going to be backtesting a Long/Short equity strategy and need some guidance on how best to deal with the short book. I was thinking that for each portfolio I would go long 50 equities and go ...
28
votes
8answers
7k views

What broker/feed/APIsetup allows for recording the most accurate data (cheaply)?

I'm currently using IB's Java API and getting feeds through them. However the real-time feed is updated only every 250ms and the historical feed only every second. I'm primarily looking for ES data ...
0
votes
0answers
161 views

How to calculate returns of backtested strategy?

Lets say I have some strategy (long/short) backtested for certain period. Strategy has entries/exits only at the end of the day and may have overnight positions hold. Now I would like to compare ...
7
votes
2answers
1k views

How to calculate the most realistic historical option prices with additional publicly available parameters

This is a follow up question of this one. My aim is to create the most realistic historical option prices possible with publicly available data. I want to do this for backtesting purposes. The ...
11
votes
3answers
3k views

Papers about backtesting option trading strategies

I am looking for all kinds of research concerning option trading strategies. With that I mean papers that publish results on different option trading strategies properly backtested with real-world ...
10
votes
3answers
361 views

How to account for market movement when some exchanges are closed?

Daily data, such as open and close prices, is often available for much longer periods than high-frequency data. However, whenever backtesting any strategy that examines instruments traded in different ...
4
votes
2answers
134 views

Back-testing Value at Risk with a WML investment strategy

I'm currently taking a course in Financial Econometrics and there is a question in the lecture notes regarding back-testing of VaR which I'm have difficulty with. First of all the procedure for ...
2
votes
2answers
230 views

How to select optimal betting strategy from backtest?

I have written a model for predicting the winner of UFC fights. My model calculates the probability of each fighter to win a given match. I have back tested the model and found it to be very ...
1
vote
1answer
213 views

Analog - Pattern Recognition model using KNN

I'm building a pattern recognition model for my master thesis. The idea is to build a framework with some Macro variables (long/short term rates; rates differential; equity; fx; vix) in order to find ...
0
votes
1answer
125 views

What data should be used for regression-based model backtesting?

I ran regressions using historical valuation data and now want to backtest the models I came up with. Are there any issues with using the same historical data set for the backtest that I need to be ...
20
votes
8answers
2k views

How to design a custom equity backtester?

I was thinking about writing my own backtester and I realize I have to make some assumptions. So I was hoping I could post what I am planning on doing and hopefully some of you can give me some ideas ...
4
votes
0answers
141 views

What is the most convenient data structure for backtesting a model of futures options prices?

I have an empirical model for the dynamics of futures prices in a particular market that I have implemented using a long series of the front five contracts. (I account for the roll in my model.) I ...
1
vote
2answers
423 views

Backtesting with Simulated Historical Data?

The trading strategies that are going to backtest well are the ones that pick the winners from the past. For example, if a trading strategy simply bought apple stock it would backtest extremely well. ...
3
votes
1answer
270 views

How to find optimal look back in quant trading models

I'm in the process of building a quantitative trading model, I want to improve on the way in which I decide upon a look back length for the indicators. I understand the different pros/cons for very ...
1
vote
3answers
416 views

Handling Missing values in stocks returns when estimating the co variance matrix

What is the best way to handle missing values when stocks did not exist for the entire historical period?.
1
vote
1answer
157 views

Plot Evolution of portfolio weights over time in R [closed]

Is there any function for plotting the evolution of portfolio weights over time in r?. I have a matrix of portfolio weights from an equal weighting strategy at rebalancing times and want to plot ...
32
votes
5answers
2k views

What are the key risks to the quantitative strategy development process?

Prompted in part by this question on data snooping, I would be interested to know: What are the key risks that should be considered when developing a quantitative strategy based on: (a) historical ...
11
votes
3answers
637 views

What benchmark/index to use for backtesting a portfolio of stock options?

What benchmark should I use for backtesting a model for when I should buy an option of a particular stock? For equities, one could say their portfolio outperformed the S&P 500. I would like to ...
2
votes
2answers
253 views

Backtesting Period

Views on timeframes for backtesting vary considerably. Curious on what timeframe/trade size leads to a statistically significant result. For example, what backtest period is reasonable for a system ...
0
votes
2answers
146 views

Sharpe Ratio and time spent in loss

Is it possible to express, given an annualized Sharpe Ratio value, what is an expected maximum/average time spent in a draw-down or something in this manner? E.g. with SR of 10, you'd expect to spend ...
0
votes
1answer
162 views

How to backtest the VaR model?

I have a sorted historical P&L vector of 250 days and say, I want to calculate the 90% VaR on this distribution. I will look for the 225 element (90% * 250 = 225) and this will be my Value at ...
3
votes
1answer
370 views

analyze strategy performance with given matrix of weights/time and weekly returns in R

I have a matrix of 259 weekly returns, 50 assets and a portfolio composition for each of the 259 weeks. I would like to test the performance of the portfolio during 52 weeks, rebalancing every 12 ...
-3
votes
2answers
769 views

Market Data For Project

I'm looking to find a service that will allow me to download historical data on stocks, bonds, options, futures, indices, etc and also to pick up new files either on a daily or weekly basis. I've been ...
1
vote
2answers
430 views

Machine Learning on matlab 2010

I am trying to develop a trading model. It uses certain technical and fundamental features and the model learns from the past. I have a 3-class output - bullish, neutral and bearish. On trying neural ...
3
votes
4answers
1k views

IB TWS & API, without IB account?

I'll be starting a MFE grad program in Fall, and some of the classes have a lab that use the IB TWS & API. I'd like to play around with it for fun this summer. Unfortunately, I don't have an IB ...
1
vote
0answers
239 views

Comparing Backtests of Value-at-Risk and Expected Shortfall

My goal is to test if ES (CVaR) empirically is a better risk measure than VaR for a set of given variables (assumed underlying distribution, confidence level, sample size) for different asset classes. ...
0
votes
1answer
395 views

backtesting with open, close, high and low

I am quite notice at the business of backtesting for an automated strategy. I was wondering, can I/should I use High and Low for this purpose? On one hand, the algorithm will see these prices, but on ...
0
votes
1answer
237 views

adjusted close prices on SP500

When I look at the adjusted close prices of SP500, for example, I notice that the numbers are always significantly below the actual closing. In the explanation of what adjusted prices are, one gets ...