# Is there any theoretical basis for pattern-recognition strategies?

Mean-reversion and trend-following strategies have some kind of a theory behind them that explains why they might work, if implemented well. Pattern-recognition, on the other hand, seems like nothing more than data mining and overfitting. Could patterns possibly have any predictive value? In other words, is there any theoretical reason why a pattern observed in historical data would be repeated in the future, other than random chance or self-fulfilling prophecy where the pattern "works" because enough traders use it?

• overfitting can generally be avoided using cross-validation Feb 2, 2011 at 3:21
• When you say "pattern recognition", are you asking about traditional technical analysis, or are you asking about statistical pattern recognition techniques such as CART, recursive partitioning, kernel regression, support vector machines (SVMs), etc? Feb 3, 2011 at 2:48
• I meant traditional technical analysis - but feel free to answer about the other kind, too.
– EMP
Feb 7, 2011 at 10:23

Weak form market efficiency says that you can't predict prices based on past prices. Or that technical analysis doesn't work. I think that the tests of weak form market efficiency are pretty conclusive and show that the US stock market is weak-form efficient; at least on a a timeline longer than a few minutes.

That's not to say that markets are "efficient". The tests of semi-strong form efficiency (i.e., can't predict prices from all public info) are still debated a little, but I think most would say that markets are not semi-strong form efficient. You can do fundamental analysis have a chance a determining winners and losers. And markets are definitely not strong form efficient (i.e., can't predict prices from all info, public and private).

So does technical analysis work? I don't think so. Some may be earning abnormal returns, but they're likely taking risks that aren't obvious from the charts. Or in the context of mean reversion, yes, most of the time things revert to the mean, but they may not revert to the mean within your tolerance for pain. I think the best light read on the mean reversion topic is "When Genius Failed". Their convergence trades on off-the-run and on-the-run Treasuries were "right", but they went further away from the mean before converging after insolvency.

• I think that the tests of weak form market efficiency are pretty conclusive and show that the US stock market is weak-form efficient @Richard Herron, can you point us to such studies? Jul 21 at 2:31
• The Fama Portfolio, which is a collection of Gene Fama's most influential papers. Each paper has a foreword that puts it in context (historical and contemporary). amazon.com/dp/B0772QY693/ref=dp_kinw_strp_1 Jul 21 at 12:59

General answer to a very general question:

If you find a significant pattern which distinguishes between structure and noise you understand something about that system. You have a model about it so you can extrapolate and forecast. On that basis you can use this model to make money. In that sense mean-reversion and trend-following are also "only" strategies that use a model derived from the data (or where ever from).

Take evolution as a proxy: The living organism also have a model about their environment (which is partly stochastic, too). The successful organisms use that to survive and breed.

As an aside: In terms of a philosophical basis you can say that it is the belief that the past has meaning for the future (inductive argument) - but this is only a belief which cannot be justified in itself (saying that it worked well in the past is itself inductive and therefore we have a catch-22 here)

To my point of view there are never any reason that a pattern or anything else would repeat in the futur. Actualy I don't see any difference between pattern recognition and mean reversion/Trend Following in term of theoretical proof. One can read Pr Andrew Lo : "Foundations of Technical Analysis". It tries to give a theoretical background to TA by studying the enpirical distribution of stock returns conditionned or not on the presence of predefined chart pattern. His result is that there is a diference that justifies the use of TA.

I do not believe market is random and neither do many members of this forum. Simply by that notion you believe that, market follow a systematic and cyclical approach. The success of any investor is to identify those cycles and take advantage of them.

Systematic, cyclical both imply the existence of pattern.However, we all believe the existence of theme or context which is the greatest cause of confusion to any trader. Is the basis of all of our problems.

• Wait... Did you just assume my view of the market? Keep in mind what Fama(1970) or Malkiel(1992) said: "A market is said to be efficient if it fully reflects all relevant information in determining security prices." I certainly believe this statement (which in fact says nothing about randomness). Jun 17, 2019 at 12:55