What benchmark should I use for backtesting a model for when I should buy an option of a particular stock? For equities, one could say their portfolio outperformed the S&P 500. I would like to have a similar means of comparison for trading stock options. The only thing I've been able to find that I think is appropriate is the VIX. Is there a better or more appropriate way to do this, so I can see how my portfolio and strategy performs in a backtest?
The best solution in most cases where one is backtesting from a non-standard universe is to construct your own index. I believe that to also be true in your case, as there is no standard index tracking the returns of a particular basket of options. VIX, in particular, is more accurately thought of as a price index, not a return index, in the options world.
To construct your own index for a long-only strategy, just take the entire universe available to your strategy and find the returns of a market-value-weighted portfolio of every security. If your strategy is both long and short, the correct index is cash. The market value you use is a bit subjective, as you could use either the market value of the underlying stock or the open interest of the options.
When testing your strategy, what you need to pay particular attention to is performance attribution, in other words why did you see the returns you did?
Let me give you a simple example to illustrate what I mean. Suppose I have an algorithm to pick stocks and you have a testing database of stock prices for one year. Suppose also that in that year the market was down 15%. You test my algorithm and find it returned -2%, beating the average by 13%. Is my algorithm a good one?
Now suppose I told you my algorithm was to take your money, charge a 2% management fee off the top and leave all the cash in a non interest bearing account. Does it sound as good now?
The question then is not if a strategy differs from a benchmark index, but rather why?
It could be because:
You selected from a different universe (comparing US equities to the DAX for example).
The risk profile of the stocks you selected differs from the universe (picking only low price stocks out of a universe of all stocks).
Your "universe" differs from the universe from which the index was constructed. For example suppose you select a test dataset consisting of all the NYSE stocks on Jan. 1, 2011 and collect returns for 2011. This would differ from the NYSE index simply because new stocks are listed during the year which were not there on Jan 1, the day you fixed your universe.
Even if these sort of technical factors are fully accounted for, there still remain many great questions for which you would like to have insight. For example if a stock portfolio does well was it:
1) Invested in the right sectors, but underperformed in those sectors?
2) Invested in the under performing sectors but picking the high performing stocks in those sectors?
3) Some permutation of the above?
Bottom line: don't just compare to an index.
|show 2 more comments|