A temporal sequence of events measured at discrete points in time.

learn more… | top users | synonyms

49
votes
7answers
18k views

Efficiently storing real-time intraday data in an application agnostic way

What would be the best approach to handle real-time intraday data storage? For personal research I've always imported from flat files only into memory (historical EOD), so I don't have much ...
33
votes
6answers
14k views

How are correlation and cointegration related?

In what ways (and under what circumstances) are correlation and cointegration related, if at all? One difference is that one usually thinks of correlation in terms of returns and cointegration in ...
33
votes
7answers
6k views

Is R being replaced by Python at quant desks?

I know the title sounds a little extreme but I wonder whether R is phased out by a lot of quant desks at sell side banks as well as hedge funds in favor of Python. I get the impression that with ...
33
votes
5answers
5k views

How do I graphically represent the evolution of a covariance matrix over time?

I am working with a set of covariance matrices evaluated at various points in time over some history. Each covariance matrix is $N\times N$ for $N$ financial time-series over $T$ periods. I would ...
30
votes
8answers
8k views

Time-series similarity measures

Suppose I have two time series $X$ and $Y$ of stock prices. How do I measure the "similarity" of $X$ and $Y$? (I'm being deliberately vague as I don't have a particular application, and I'm curious ...
27
votes
2answers
3k views

How much data is needed to validate a short-horizon trading strategy?

Suppose one has an idea for a short-horizon trading strategy, which we will define as having an average holding period of under 1 week and a required latency between signal calculation and execution ...
25
votes
4answers
6k views

What is a stationary process?

How do you explain what a stationary process is? In the first place, what is meant by process, and then what does the process have to be like so it can be called stationary?
20
votes
6answers
8k views

What is the intuition behind cointegration?

What is the intuition behind cointegration? What does the Dickey-Fuller test do to test for it? Ideally, a non-technical explanation would be appreciated. Say you need to explain it to an investor ...
19
votes
8answers
10k views

What is the best data structure/implementation for representing a time series?

I was wondering what is best practice for representing elements in a time series, especially with large amounts of data. The focus/context is in a back testing engine and comparing multiple series. ...
19
votes
2answers
2k views

How to quickly estimate a lower bound on correlation for a large number of stocks?

I would like to find stock pairs that exhibit low correlation. If the correlation between A and B is 0.9 and the correlation between A and C is 0.9 is there a minimum possible correlation for B and C? ...
18
votes
6answers
2k views

How random are financial data series?

Pseudorandom number generators are often tested using e.g. a test suite like Diehard tests or Dieharder. If one would run these tests e.g. on stock market time series or other financial data, would ...
17
votes
2answers
2k views

Is there a standard method for getting a continuous time series from futures data?

I would like to be able to analyse futures prices as one continuous time series, so what kinds of methods exist for combining the prices for the various delivery dates into a single time series? I am ...
16
votes
3answers
4k views

Can the concept of entropy be applied to financial time series?

I am not familiar with the concept of entropy for time series. I am looking for good reference papers and examples of use.
15
votes
4answers
14k views

Why are GARCH models used to forecast volatility if residuals are often correlated?

The answers to this question on forecast assessment suggest that if the sequence of residuals from the forecast are not properly independent, then the model is missing something and further changes ...
15
votes
2answers
2k views

How to update an exponential moving average with missing values?

Say you have an Exponential Moving Average being continuously updated over a time series using 1-second-long time periods. What should happen if there is no value for the next second, e.g. there were ...
13
votes
6answers
25k views

How to check if a timeseries is stationary?

I'm using KPSS Method to check if the series is stationary, but I would also like to use another test to confirm if the series is stationary or not, what method coudl I use?
13
votes
2answers
1k views

How to forecast expected volatility from high-frequency equity panel data?

I'm wading through the vast sea of literature on realized volatility estimation and expected volatility forecasting (see, e.g. Realized Volatility by Andersen and Benzoni, which cites 120 other ...
13
votes
1answer
2k views

What is a good topic on financial time series analysis for master thesis?

Can someone suggest a topic or some reasonably narrow area in financial time series analysis (e.g. statistical, machine learning, etc.) which can make a good topic for a master thesis? By 'good' I ...
13
votes
1answer
419 views

What should be considered when selecting a windowing function when smoothing a time series?

If one wants to smooth a time series using a window function such as Hanning, Hamming, Blackman etc. what are the considerations for favouring any one window over another?
12
votes
6answers
2k views

How to generate a random price series with a specified range and correlation with an actual price?

I want to generate a mock price series. I want it to be within a certain range and have a defined correlation with the original price series. If I choose, say, oil, I want as many time series which ...
12
votes
4answers
2k views

Are two identical time series cointegrated?

I did cointegration test on two identical time series, and the result shows that they are not cointegrated, but intuitively, I think they are. Can anyone share some thoughts on this? Thanks!
12
votes
4answers
6k views

R: Fast and efficient way of running a multivariate regression across a (really) large panel (First pass of Fama MacBeth)

I am attempting to run a rolling multivariate regression (14 explanatory variables) across a panel of 5000 stocks: For each of the 5000 stocks, I run 284 regressions (by rolling over my sample ...
12
votes
1answer
656 views

Meta-view of different time-series similarity measures?

While I spend most of my StackExchange time on MathematicaSE, I'm in the business and follow the questions and answers on this site with great interest. Recently questions like the following (and ...
11
votes
3answers
1k views

How to detect regime change when estimating asset correlation from historical time series?

Suppose I have two asset time series, $X_t$ and $Y_t$, and I'm estimating their correlation from historical data. I'd like to apply some systematic criterion to estimate what time window I should use ...
11
votes
3answers
524 views

What is a commonly accepted econometric model for volume?

What is the gold standard econometric model for volume? For example, a common model for price is the autoregressive (AR) model with GARCH(1,1) innovations. Do you know of any good survey articles ...
11
votes
5answers
3k views

How to interpolate gaps in a time series using closely related time series?

I am trying to construct a daily time series of prices and returns for some large universe of securities. However, all I have available are a monthly time series of the prices/returns (as well as ...
11
votes
3answers
3k views

How do I calculate the skewness of a portfolio of assets?

I need to calculate the skewness of a portfolio consisting of 6 assets. I know that for that I would need the co-skewness matrix between the assets. Does anybody know the formula for co-skewness or ...
11
votes
2answers
1k views

How to detect structural breaks in variance?

I'm looking for a method to automatically detect structural breaks, I tried Chow test, It works good but it doens't work for breaks in variance. Do you know a test to check strucutural break in ...
11
votes
3answers
1k views

Literature on generating synthetic time series for testing

I have some market data (daily time series) for bond prices and CDS indices and I would like to generate synthetic versions of these which are statistically "similar" for testing trading strategies. ...
11
votes
4answers
687 views

Thesis using Momentum strategies in R, tips on good books, guidelines etc on how to do the programming?

I am quite new to R and will be doing an empirical analysis of momentum strategies in R using a dataset from the index OSEAX from 1980 to 2014. The momentum strategy will for the most part resemble ...
11
votes
1answer
568 views

Alternative ways to understand time-varying comovement between two time-series?

I have been looking into ways to better understand how the dependencies/correlations/etc between two time series can vary over time. I first thought about using a Kalman/particle filter over a ...
10
votes
3answers
367 views

How to account for market movement when some exchanges are closed?

Daily data, such as open and close prices, is often available for much longer periods than high-frequency data. However, whenever backtesting any strategy that examines instruments traded in different ...
10
votes
2answers
398 views

How to “uncluster” a set of financial data?

I am attempting to evaluate and compare the profit factor of different "test runs" of a FOREX trading strategy. My problem is that, despite an average time between orders of 2hr+, some of these runs ...
10
votes
2answers
425 views

GARCH model, expectation of volatility?

Consider a time series $\{r_t\}$ following a standard GARCH(1,1) model, i.e., $$ r_t = \sigma_t \epsilon_t,$$ where $\epsilon_t \sim N(0,1)$ and are i.i.d, and $$\sigma_t^2 = \omega + \alpha_1 ...
9
votes
1answer
544 views

What methods do I need to learn in order forecast asset price movements?

What are the standard models used to forecast asset price movements? For example, if I were to trade an option, what model would I use in conjunction with option pricing models to forecast the stock ...
9
votes
1answer
271 views

Is a linear combination of GARCH processes also a GARCH process?

If two time series follow a GARCH process, and a third is a linear combination of them, is the third also GARCH process?
9
votes
1answer
947 views

Why does the following data fail my cointegration test?

I have some closing price data for two Australian banks which track each other very closely. http://dl.dropbox.com/u/12337149/stat/CBA.csv http://dl.dropbox.com/u/12337149/stat/WBC.csv Code from ...
9
votes
1answer
2k views

Time series price prediction and linear regression: using high/low rather than last quotes price

Discrete time series regression models, like ARIMA, are usually built around the assumption that we only have 1 available price for each period t, which I will call the Close. In reality asset time ...
9
votes
1answer
5k views

Time Series Regression with Overlapping Data

I am seeing a regression model which is regressing Year-on-Year stock index returns on lagged (12 months) Year-on-Year returns of the same stock index, credit spread (difference between monthly mean ...
9
votes
1answer
304 views

Time series analysis on illiquid price data?

Say for example I have the following company in some specialized industry: A - Company that is about to be listed in Exchange 1, i.e., no price history B - Company that produce similar products as ...
9
votes
1answer
370 views

Can Hurst exponent be used to characterize nonlinear dependence in time series?

It appears to me that the answer is no, because Hurst exponent measures persistence in terms of autocorrelation, which is a linear measure. So even if a time series of asset returns is driven by ...
9
votes
0answers
429 views

Can we use White's reality check to compare two Sharpe ratios?

I read a paper from Ledoit and Wolf that proposes a method to compare two Sharpe ratios and a paper from White that proposes a method to compare $n$ trading rules. My question is: Can we use White's ...
8
votes
4answers
18k views

How to fit ARMA+GARCH Model In R?

I am currently working on ARMA+GARCH model using R. I am looking out for example which explain step by step explanation for fitting this model in R. I have time series which is stationary and I am ...
8
votes
3answers
572 views

How to test for and how to simulate price rise/fall asymmetry in the stock market

One of the stylized facts of financial time series seems to be a fundamental asymmetry between smooth upward movements over longer periods of time followed by abrupt declines over relatively shorter ...
8
votes
3answers
9k views

Are public historical time series available for ratings of sovereign debt?

The nice list of free online data sources Data sources online does not mention any data from ratings agencies. Are historical time series available for sovereign credit ratings (other than as ...
8
votes
3answers
365 views

Does Kalman filter always improve over linear regression?

If I have a simple linear regression that has statistical signification but I would like to improve the overall prediction results. Will a Kalman filter be always an improvement or as least achieve ...
8
votes
2answers
645 views

Is there any research on applying state-space or dynamic linear models to forecasting equity risk premia?

Is there any research on applying state-space or dynamic linear models to forecasting equity risk premia on a security-by-security basis with a medium term horizon (say 3 month to 12 months horizon)? ...
8
votes
3answers
260 views

Are there any standard techniques for adding realistic synthetic microstructure noise to a price series?

This may seem like a strange question, but for my particular application we need to actually add synthetic microstructure noise to real time charts. The signal should still be representative of the ...
8
votes
2answers
940 views

time series management system

I'm happy how we store a single time series but we somehow lack a system that glues them all together. I'm talking about a few million time series coming from ~50 data vendors and representing maybe ...
8
votes
0answers
115 views

2-state HMM / ARMA process?

I have issues with this problem: Let $\{X_t, t\in \Bbb N\}$ be a 2-state stationary Markov chain, with transition $M$ (and $M(1,2)\neq 0 \neq M(2,1)$), let $\{W_t, t\in \Bbb N\}$ be a strong Gaussian ...