Questions about handling, obtaining, generating, or analyzing all types of financial or economic data.

learn more… | top users | synonyms

3
votes
1answer
279 views

mortgage prepayment model

I am trying to develop my own MBS prepayment model. I am confused by the terms SMM and CPR. Are they estimates/models in themselves or are they ACTUAL data for the MBS pool. where can I find actual ...
2
votes
1answer
139 views

Historical data on short rates

I would like to backtest a short-equity strategy. I'm looking for historical data on the availability of shares and cost to short certain stocks. Does anyone know of such data being available ...
2
votes
4answers
2k views

Data source for historical Share Outstanding totals for individual stocks?

Data is normally adjusted for splits/reverse splits, etc. The current shares outstanding is usually available. Is there a data repository that captures the shares outstanding for any point in the ...
1
vote
1answer
124 views

Brent Crude Data

I am trying to locate historical volatility data (5+ years) for Brent Crude? Does anyone know where I might be able to source such data?
3
votes
1answer
289 views

Should I use SSAS to store Tick and bar data?

I have been looking for a low cost solution to effectively store and query tick and bar data. Databases like kdb+ and Streambase are too expensive for me. Building a custom solution with SSAS (Sql ...
4
votes
1answer
2k views

Why use a column database for tick/bar data?

I often hear that column-oriented databases are the best choice method for storing time series data in finance applications. Especially by people selling expensive column-oriented databases. Yet, at ...
1
vote
1answer
237 views

Normalized data

I am new to this. I trained and tested my data using SVM in Matlab with the autoscale option true => the data would be normalized with unit SD. Let's say the training data have the price around 200. ...
3
votes
2answers
742 views

Tick data collection

I am new to this. I am confused on what consists of a tick data. I have a trading platform in which I could collect data of exchange traded product like futures and stocks. While I am intending to ...
8
votes
3answers
766 views

Why isn't all market data free?

I am hoping any answers can be threaded somewhere between "don't be naive" and starting a quasi-political flame. Transparency is suppose to be good for markets and also a social good. The market ...
5
votes
1answer
663 views

Automated 10-K XBRL data grab using the SEC file structure

I would like to write a program that takes as input a list of CIK/year/quarter entries. The program should iterate through the list and, for each entry, grab XBRL financial data from the SEC website ...
10
votes
8answers
5k views

Is “eoddata” a good data source?

Not sure if this is a relevant question for site, but I am looking to move to www.eoddata.com as my data source. If anyone has used it, can you tell me how the data quality is ? I am currently ...
6
votes
1answer
359 views

NASDAQ TotalView ITCH order reference number number characteristics

I am building a custom hash implementation for storing NASDAQ ITCH order messages. Obviously this is keyed on the order reference number and I am wondering if these numbers are sequential, random or ...
7
votes
2answers
1k views

Non-SQL methods for high-frequency accounting?

Does anyone know of any prior art for non-SQL data structures for high-frequency accounting, whether client, broker, or exchange-side? I'm thinking specifically of the problem of booking individual ...
8
votes
1answer
413 views

Where can I find data on the interbank lending market?

Where can I find disaggregated interbank lending data (i.e. bank A lends to bank B x money at y rate)? I could only find data on interest rates. I would accept LIBOR market data as well as any ...
11
votes
3answers
4k views

R: How feasible is it to store — and work with — tick data in a database connected to R?

I'm looking to convert some tickdata .csv files into a database on a local disk and then use R to call the data and do my various analytics and modelling. What are some best practices / ...
2
votes
0answers
171 views

Can a higher P/E ratio be beneficial under certain circumstances? [closed]

I am new to investing. I understand that the P/E ratio along with other data can be used to determine whether a stock may or may not be undervalued. Are there situations where a HIGH P/E is actually ...
3
votes
2answers
232 views

Which indices to use for an equity vs. fixed-income portfolio simulation?

I want to backtest several basic optimization methods (e.g. MVO, "most-diversified portfolio"), and I want to do this on a basket of different asset indexes. To start with, I want to simulate a 60/40 ...
4
votes
0answers
106 views

single channel for multiple feeds of news? [closed]

I subscribe to various blogs and twitter feeds which I use to parse for keywords. Many times these subscriptions do not include topics which are of the primary concern. Are there multiplex channels ...
8
votes
2answers
811 views

time series management system

I'm happy how we store a single time series but we somehow lack a system that glues them all together. I'm talking about a few million time series coming from ~50 data vendors and representing maybe ...
3
votes
0answers
305 views

What is a good site to download historical stock 'events' such as earnings releases? [duplicate]

Possible Duplicate: What data sources are available online? Earnings and valuation data sources online I'd like to backtest some strategies involving earnings release surprises, as well ...
1
vote
0answers
758 views

Historical S&P 500 Stock Weights [closed]

I'm looking for histocial weights of S&P 500 constituents. I have access to a Bloomberg terminal. Any thoughts on how/where I might calculate/find these data? P.S. I'm looking for as much data as ...
6
votes
2answers
283 views

Where can you find data on non-trading stocks?

My data source for end of day prices only gives the prices of the trades during the day. If a stock stops trading/goes out/moves to another exchange|changes symbol. I never hear about this. My ...
7
votes
3answers
320 views

Is there data on market participants at a particular moment?

I am looking for data on market participants at a particular moment (or some proxy/approximation). For example, how can I tell whether mostly big players and HFTs are dominating the market in ...
-1
votes
1answer
491 views

Way to download current stock information (for free)? [duplicate]

Possible Duplicate: What data sources are available online? Is there a free way to download the current prices (and possibly other data) for stocks for various companies? Context: This is ...
10
votes
2answers
352 views

How to “uncluster” a set of financial data?

I am attempting to evaluate and compare the profit factor of different "test runs" of a FOREX trading strategy. My problem is that, despite an average time between orders of 2hr+, some of these runs ...
6
votes
4answers
225 views

What is a sound way to project Company X's earnings over the next Y years?

I need to estimate cumulative earnings over the next Y years and I'd like to find a solution that is theoretically sound and relatively simple. Can anyone recommend an approach? Given: I have 30 ...
20
votes
2answers
2k views

How much data is needed to validate a short-horizon trading strategy?

Suppose one has an idea for a short-horizon trading strategy, which we will define as having an average holding period of under 1 week and a required latency between signal calculation and execution ...
10
votes
3answers
548 views

Literature on generating synthetic time series for testing

I have some market data (daily time series) for bond prices and CDS indices and I would like to generate synthetic versions of these which are statistically "similar" for testing trading strategies. ...
7
votes
4answers
2k views

Real-time & Fast S&P 500 E-Mini Futures (ES) Data

I trade on local exchanges in Europe, but my HFT strategies need S&P 500 e-mini futures data (ES). I don't need to trade ES, but I need real-time data and I want to have it as fast as possible. ...
8
votes
3answers
1k views

How to generate synthetic FX data for backtesting?

I want to generate synthetic forex data for the purpose of backtesting my trading algorithms. I have some rough ideas in mind on how to do this: Start with a curve representing a trend, then randomly ...
14
votes
6answers
15k views

Where to download list of all common stocks traded on NYSE, NASDAQ and AMEX?

I have a very basic data question: how to get a list of all common stocks traded on NYSE, NASDAQ and AMEX? I would need to be able to get the approximate list of common stocks as is available in ...
12
votes
1answer
434 views

What time are Bloomberg Open Symbology Files updated daily?

Does anyone know what time the Bloomberg Open Symbology precanned files are updated every day? I am planning on upating my view of them at 9 AM EST every morning. Furthermore, will the files for ...
5
votes
1answer
428 views

Historical Hedge Fund Index Data

Can anyone point me to some Hedge Fund index data - daily levels of the HFRX or something similar, that is available for free and has history back to 2007? The data available through my broker seems ...
3
votes
1answer
944 views

How do I backtest a convertible bond arbitrage strategy in R/Matlab?

Since no one was able to answer my previous question, I am going to try to backtest a modern convertible bond arbitrage strategy myself (perhaps I'll report the results back here, if you're lucky :)). ...
-3
votes
2answers
700 views

Market Data For Project

I'm looking to find a service that will allow me to download historical data on stocks, bonds, options, futures, indices, etc and also to pick up new files either on a daily or weekly basis. I've been ...
6
votes
3answers
890 views

Which data service to buy for redistributable data?

This is a follow-up to my previous question regarding anyone whom wanted to 'donate' data. So far no one has stepped up (learning more about buying and selling data, I realize that I'm going to have ...
9
votes
1answer
261 views

Is there a standard / methodology to determine and grade the quality of OHLC data?

Inputs are most important to any decision making. For strategy backtesting, the OHLC data is one of the most inputs. So to ensure the correctness and integrity of OHLC data, we have checks on the ...
14
votes
4answers
6k views

Usage of NoSQL storage in Finance

I am wondering if anyone has used NoSQL (mongodb, cassandra, etc.) to store and analyze data. I tried searching the web but was not able to see if the financial firms had gotten in to using nosql ...
1
vote
0answers
587 views

Hobbyist Quants [closed]

I'm interested in investing some money in the stock market, and I have the math background that will make following the math used in quantitative finance possible (with some work). What are the ...
17
votes
2answers
2k views

Do you have historical tick data you want to donate?

Do you have historical market/pricing ticket data that you would like to donate to the Open Source Trader project (OST)?? Please: upload your files! Once we gather some data, we'll do our best to ...
6
votes
1answer
934 views

A generic limit order book: What are the most important queries it should be able to answer?

Assume a class LimitOrderBook which represents a limit order book in a trading system. To be able to represent the limit order book a data handler reads a feed ...
3
votes
3answers
2k views

Monthly data for popular indices (constituents).

Trying to be concise: I am interested in the most popular indices (SP500, FTSE100, DAX30, CAC40, SMI30, etc). For each index I want to know its constituents in a monthly basis. For each constituent ...
9
votes
5answers
2k views

Earnings and valuation data sources online

Are there any free/cheap sources for historical data on company earnings and valuations? I can get historical price data from Google and Yahoo, and it looks like I can get about five years of ...
4
votes
2answers
941 views

Mass Market Data Source

My current project requires large amounts of historical and real-time market data (1m or 5m bars for various products, mostly US futures for as far back as available). This data will be analyzed by ...
5
votes
1answer
170 views

Reliable Economic Data on China

Trying to develop a new strategy, but I need to find reliable economic data on China. It's well known that the official figures there don't tell you everything (to put it nicely), so I was wondering ...
10
votes
2answers
651 views

Why is the ratio of Hi-Low range to Open-Close range close to 2?

I tried it in several symbols and timeframes with the same result: $$\frac {mean(HIGH-LOW)}{mean(|CLOSE-OPEN|)}$$ ...
9
votes
2answers
229 views

Effective Euro-USD (EURUSD) Exchange Rate Prior to Euro's Existence

Motivation: I am running a quantitative analysis that requires long-term, exchange rate data. Problem: Does anyone have methods for dealing with the EURUSD exchange rate prior to the Euro's ...
13
votes
3answers
4k views

Free market data (delayed or snapshot)

I know there are similar questions but I don't think there are any identical ones. Basically, I'm looking for one of these two things. Delayed market data feed. A tick by tick feed, but delayed by ...
18
votes
8answers
6k views

Any known bugs with Yahoo Finance adjusted close data ?

Yahoo Finance allows you to download tables of their daily historical stock price data. The data includes an adjusted closing price that I thought I might use to calculate daily log returns as a ...
5
votes
2answers
604 views

FX Tick Data question

Anyone can tell me what the first column and the last column in this FX tick dataset mean? The first seems like some kind of ID, and what D in the last column mean? 368412956 AUD/CAD 12/30/2007 ...