Tagged Questions

The study of the collection, organization, analysis, and interpretation of data. Questions may deal with descriptive statistics, probability distributions, random variables, sampling, regression, density estimation, filtering, inference, estimation theory, or computational statistics.

3answers
260 views

Profit estimation with a dice: 10 dollars for 6, -1 dollar for anything else

I recently found the following question: What is your profit estimate throwing a dice in the long run if you get 10 dollars for each time you hit 6 and lose 1 dollar for any other number? I tried to ...
2answers
1k views

How to make the final Interpretation of PCA?

I have question regarding final loading of data back to original variables. So for example: I have 10 variable from a,b,c....j using returns for last 300 days i got return matrix of 300 X 10. ...
1answer
3k views

Hurst Exponent Calculation

I am trying to calculate the Hurst Exponent using Excel. I am facing a problem where the exponent value sometime goes beyond 1. Can someone share a link / material so that it will help me to calculate ...
1answer
519 views

Coin Toss System

Coin Toss Runs Calculator The expected number of runs for two consecutive heads or tails is 3. Is there an edge if we place a progressive constant size bet(limited to 3 times)for consecutive ...
2answers
166 views

What are the proper metrics to look at for checking discrepancies in these two time series

I am obtaining bid/ask price and volume market data from two different sources for the same ticker and for the same day and checking to see that at time intervals X they are "roughly the same". The ...
3answers
4k views

Can the Hurst exponent be greater than one?

Can the Hurst exponent be greater than one? Does it mean that the time series follows a random walk or that it's not stationary?
2answers
687 views

.NET statistical packages recommendation

What open source or commercial .NET statistical package would you guys recommend? I am doing statistical arbitrage in options. The functions I need mainly are regressions, optimizations..etc. It would ...
2answers
1k views

Detrending price data for analysis of signal returns

I'm looking to conduct hypothesis tests on some of my trading signals to see if the signal returns are statistically significant enough to falsify my null hypothesis that the signal has no predictive ...
6answers
637 views

Encyclopedia of Statistical Tests

I am aware of: Encyclopedia of Chart Patterns, Encyclopedia of Technical Analysis. Question I'm wondering if there's something similar, but in the form of: "Encyclopedia of Statistical Backtesting ...
0answers
161 views

Is it more accurate to analyze returns on a calendar day basis than a trading day basis?

I'm rather new to the actual practice of this kind of analysis, but it just seems wrong to me to throw Mondays' returns in with the rest without accounting for the passage of time on the weekend when ...
1answer
165 views

help me compare methods to compute one instrument price from another instrument price

Assume we have two instruments A and B. Also time is increasing from 1 to n. Let's say that ...
1answer
2k views

Skewness and Kurtosis under aggregation

Returns possess non-zero skewness and excess kurtosis. If these assets are temporally aggregated both will disappear due to the law of large numbers. To be exact, if we assume IID returns skewness ...
8answers
7k views

Should I use an arithmetic or a geometric calculation for the Sharpe Ratio?

What are the advantages/disadvantages of using the arithmetic Sharpe Ratio vs the geometric Sharpe Ratio? Is one more correct? Or is one better in certain circumstances?
1answer
493 views

How to model time series of illiquid stocks - 400 observations (transactions) per 8 hours?

How to model time series which are illiquid - 400 observations (transactions) per 8 hours ? Are there models suitable for this situation which incorporate not only size of the transactions but also ...
3answers
730 views

What are some research articles on using principle components to generate alpha?

Here's an example by Marco Avellenada from NYU titled "Statistical Arbitrage in the U.S. Equities Market". The idea of this paper involves capturing mean reversion in the residual returns of a ...
5answers
1k views

How to fit probability density function from sample moments?

If I have calculated the sample mean, variance, skew and kurtosis of a set of data, how would I go about fitting a probability distribution to match these moments (i.e. choosing a probability ...
0answers
477 views

ATM volatility versus OTM volatility and directional standard deviation

The forward instrument vol curve is skewed to the downside (50 delta risk reversal, 25 put, 25 call) were trading several ticks to the put). Is there a smaller standard deviation (in price terms) to ...
1answer
753 views

How are Expected Shortfall and Variance related?

I would like to know how Expected Shortfall $SF_\alpha$ and variance $\sigma^2$ are related. If I follow what Aaron Brown answered in this post, when the underlying distribution is Normal with ...
1answer
1k views

What is the best way to forecast prepayment rate in an emerging market mortgage loan portfolio?

I constructed a model to forecast the prepayment rates for a mortgage loan portfolio (of mortgages in an emerging market) using probit regression on factors such as loan-to-value, PTI, time from ...
3answers
320 views

How to improve the consistency of explained variance statistics in a linear equity model?

I have an intraday equity returns linear model that, overall, shows good values in terms of $R^2$, p-value and other explained variance statistics. Around 70% of the stocks show consistent R-squared ...
1answer
2k views

Why is the first principal component a proxy for the market portfolio, and what other proxies exist?

Let's say that I have a universe of stocks from a certain sector. I want to compute the market portfolio of this sector. Beta is the covariance between each stock and the market. But how do you ...
3answers
535 views

How to test for and how to simulate price rise/fall asymmetry in the stock market

One of the stylized facts of financial time series seems to be a fundamental asymmetry between smooth upward movements over longer periods of time followed by abrupt declines over relatively shorter ...
5answers
2k views

How to interpolate gaps in a time series using closely related time series?

I am trying to construct a daily time series of prices and returns for some large universe of securities. However, all I have available are a monthly time series of the prices/returns (as well as ...
3answers
448 views

How to group timeseries showing similar curve

I am trying to classify similar looking curves of a timeseries and was wondering what is the best algorithm to research. Reading R, it looks like k-means clustering could be applied - but I don't know ...
2answers
950 views

What is the precision of standard deviation estimates with small samples?

I was asked today to "quantify" the precision of an estimated the standard deviation from a small sample, I was not sure how to answer. The case is quite simple, I have a sample of $n=25$ measures ...
5answers
4k views

What exactly is meant by “microstructure noise”?

I see that term tossed around a lot, in articles relating to HFT, and ultra high frequency data. It says at higher frequencies, smaller intervals, microstructure noise is very dominant. What is ...
2answers
2k views

How can I compare distributions using only mean and standard deviation?

I only have means and standard deviations of samples of two random variables. What technique can I use to determine how similar the distributions these describe are? Assume that the values are built ...
2answers
3k views

Calculating Portfolio Skewness & Kurtosis

I need to calculate the skewness and kurtosis of 2 asset portfolio, can someone please help me with the formulas and definition of terms? Thank you. I have been using the matrices method and I am not ...
1answer
532 views

Has any research used Bayesian networks to estimate risk factor betas?

Is there any published research on estimating the beta of a security with respect to one or more risk factors via Bayesian networks? I'd like to see if this is a promising angle of research.
1answer
884 views

Why does the following data fail my cointegration test?

I have some closing price data for two Australian banks which track each other very closely. http://dl.dropbox.com/u/12337149/stat/CBA.csv http://dl.dropbox.com/u/12337149/stat/WBC.csv Code from ...
1answer
7k views

How to interpret the eigenmatrix from a Johansen cointegration test?

I ran a Johansen cointegration test on 3 instruments, A B and C. The results that I got are: R<=x | Test Stat | 90% | 95% | 99% r=0 --> 36.7 | 18.9 | 21.1 | 25.8 r=1 --> ...
4answers
7k views

What is the best way to “fix” a covariance matrix that is not positive semi-definite?

I have a sample covariance matrix of S&P 500 security returns where the smallest k-th eigenvalues are negative and quite small (reflecting noise and some high correlations in the matrix). I am ...
2answers
212 views

Is it better to grade hedging strategies based on the sum of absolute or squared hedging errors?

Let's say I have one strategy that has a hedging error of: 2, 2, -2, -2 Let's say I have another strategy that has a hedging error of .5, .5, 3, 3 Would it be a better idea to grade the hedging ...
1answer
514 views

Are shorter holding period strategies better?

Consider two statistically identical strategies (identical information ratios, sample size, ratio of transaction costs to total profit, etc.) except that one has a much shorter average holding period. ...
1answer
887 views

What is the Sugihara Trading System?

I recently heard the term Sugihara Trading System. I guess it might be some trading strategy or a special model to predict trends in market data, but I couldn't find out anything about it. Does anyone ...
1answer
182 views

What tradeoff is there to using an accurate estimate with a large confidence interval?

I am working on calibrating a Heston model from simulated historical stock data. After obtaining an accurate estimate of the model parameters I found very large 95% confidence intervals for these ...
3answers
2k views

How to generate synthetic FX data for backtesting?

I want to generate synthetic forex data for the purpose of backtesting my trading algorithms. I have some rough ideas in mind on how to do this: Start with a curve representing a trend, then randomly ...
5answers
3k views

How many explanatory variables is too many?

When researching any sort of predictive model, whether using ordinary linear regression or more sophisticated methods such as neural networks or classification and regression trees, there seems to ...
1answer
130 views

How to reconstruct a discontinued economic time series such as the Fed's CP rate?

The old 3-Month Commercial Paper Rate (CP3M) on FRED was discontinued in 1997. I would like to reconstruct this series in a reasonable fashion, so I can use it to analyze more recent events. I was ...
2answers
3k views

How can I estimate the degrees of freedom for a Student's T distribution?

I am doing research estimating the value at risk for non-normally distributed assets. I need help in the process of estimating the parameters of Student's t distribution and which method to use. I ...
3answers
2k views

How do I calculate the skewness of a portfolio of assets?

I need to calculate the skewness of a portfolio consisting of 6 assets. I know that for that I would need the co-skewness matrix between the assets. Does anybody know the formula for co-skewness or ...
2answers
438 views

Efficiency vs. Robustness - To use a constant or not in single factor time-series regression?

Arbitrage pricing theory states that expected returns for a security are linear combination of exposures to risk factors and the returns on these risk factors. Betas, or the exposures of the security ...
1answer
4k views

Annualzing the log of daily returns riddle

Two popular ways to measure returns are Arithmetic returns and Log returns. Let's define arithmetic (simple period) returns as: P(t) - P(t-1) / P(t-1). Let's define log return as Ln( P(t)/P(t-1) ) or ...
1answer
456 views

Comparing backtesting returns with real trading returns

I have 10 years of backtested simulated performance of some trading strategy (using historical prices), and N months of actual trading performance. What statistical test can I do find out if I'm on ...
6answers
2k views

How random are financial data series?

Pseudorandom number generators are often tested using e.g. a test suite like Diehard tests or Dieharder. If one would run these tests e.g. on stock market time series or other financial data, would ...
5answers
2k views

How can I quantitatively test the validity of momentum indicators?

I am learning about quantitative finance, and I am struck by how different it is from the techniques that make it into magazines and TV, particularly technical analysis. Specifically, if they say an ...
1answer
447 views

How to estimate the covariance of an index with a basket of stocks?

What would be an ideal way to estimate the covariance of an index with a basket of stocks? For example, should I use one-tail ANOVA test or an individual stock & index F-test?
6answers
11k views

How are correlation and cointegration related?

In what ways (and under what circumstances) are correlation and cointegration related, if at all? One difference is that one usually thinks of correlation in terms of returns and cointegration in ...
4answers
2k views

Are two identical time series cointegrated?

I did cointegration test on two identical time series, and the result shows that they are not cointegrated, but intuitively, I think they are. Can anyone share some thoughts on this? Thanks!
1answer
2k views

How do I reproduce the cross-sectional regression in “Intraday Patterns in the Cross-section of Stock Returns”?

Recently I was trying to reproduce the results of "Intraday Patterns in the Cross-section of Stock Returns". The authors used cross-sectional regression to determine which intraday lags have ...