Take the 2-minute tour ×
Quantitative Finance Stack Exchange is a question and answer site for finance professionals and academics. It's 100% free, no registration required.

I have recently began work on some high frequency financial tick data. I have been told to 'normalize' the data as much as possible and run linear regressions through them. In fact, the data doesn't seem to be anymore linear after I did transformations on them (box-cox/log etc) I understand the linear regressions bit, but most financial data is non-normal anyway, so why bother normalizing?

share|improve this question
1  
cause otherwise you can't compare it? –  LazyCat Jul 29 at 13:57
1  
Normalization typically means subtract the mean and divide by the standard deviation. That transformation won't make non-normal data normal. –  John Jul 29 at 14:33
    
sorry, what i meant by normalizing is to make the distribution look like a normal distribution as much as possible. hence the 'normalize' –  evilbiscuit Jul 30 at 8:34
    
@John OP mentioned "log". I am guessing this means taking the log or the log return? –  BCLC Jul 31 at 5:22
    
@BCLC Well you could use logs or log returns with economic and financial data. Depends on what you're doing. –  John Jul 31 at 13:02

2 Answers 2

Short answer:
It offers some degree -- and in many cases, a greater degree -- of comparability between two types of data (different assets, returns, etc.)

Long answer:
You may already know this, but keep in mind that "normalization" can mean different things (see this question). There are various methods and purposes for normalizing data (financial or otherwise) but keep things in perspective. Normalize when doing so would be helpful for what you're trying to accomplish, and use a normalization technique that is appropriate. Linear regression has limitations, taking the logarithm has limitations, and so on. It's great to have a big toolbox of different data transformations, but part of that is knowing what to use.

As an aside, you're right that empirically markets have not exhibited normal returns. In fact, Mandelbrot explains in this article that the Pareto distribution is more realistic. It was published in 1963, but more recently he talks in this book about how the data have continued to demonstrate this pattern. The point is that you may read or hear about normalization techniques that rest on assumptions like normality that may not always be suited to the problem at hand. At the risk of editorializing, the assumption of normality has been subtly embedded in a lot of financial research and it may sometimes be misleading, so make sure to check the assumptions underlying what you're being told.

share|improve this answer

got an answer from one of my pals, thought it might be interesting to share it here. The reason why we often use the normal distribution is because the distribution will be stable regardless of the number of samples (central limit theorem).

Imagine you had a normal distribution after transforming x amount of samples, and across time, u get more variables and we will want them to stay in the 'normal' distribution shape by exploiting the central limit theorem.

However, if you have exponential/Pareto (or any other) distributions, the distribution will tend to a normal distribution once the sample size is large enough due to the central limit theorem. This way, we can have a consistent model regardless of the time/sample size.

Hope this helps, and if anyone have different ideas about this, please do comment here!

share|improve this answer
    
Watch out for the assumptions underlying the central limit theorems! (there are many CLT, the most well-known one the CLT for i.i.d. [non-degenerate] random variables) You will no longer be looking at the actual variables when applying the i.i.d. CLT, but at their mean (transformed, in fact). –  Jerome Baum Aug 4 at 21:52

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.