Questions about handling, obtaining, generating, or analyzing all types of financial or economic data.

learn more… | top users | synonyms

18
votes
8answers
7k views

Any known bugs with Yahoo Finance adjusted close data ?

Yahoo Finance allows you to download tables of their daily historical stock price data. The data includes an adjusted closing price that I thought I might use to calculate daily log returns as a ...
1
vote
1answer
250 views

Components of an index in a specific date

Objective: Get a list of all the companies that were ever part of an index (e.g.: FTSE100) in a given period of time (scale: years/decades). Method I have in mind: 1) Create an empty list k. 2) Get ...
13
votes
7answers
5k views

What is the best data structure/implementation for representing a time series?

I was wondering what is best practice for representing elements in a time series, especially with large amounts of data. The focus/context is in a back testing engine and comparing multiple series. ...
9
votes
5answers
3k views

Earnings and valuation data sources online

Are there any free/cheap sources for historical data on company earnings and valuations? I can get historical price data from Google and Yahoo, and it looks like I can get about five years of ...
0
votes
1answer
79 views

Where can I find monthly/weekly historical data for gold and silver [duplicate]

Preferably in monthly or weekly denomination, for at least 20 years. Preferably in Excel format, but csv, or other format is fine too. I try to google but couldn't find anything, maybe I just wasn't ...
2
votes
1answer
389 views

Open source equity/bond index data

I have been using the tseries package of R (get.hist.quote) to get historical quotes for various indices from yahoo finance. I am interested in DAX, VDAX, EB.REXX ...
4
votes
2answers
1k views

Mass Market Data Source

My current project requires large amounts of historical and real-time market data (1m or 5m bars for various products, mostly US futures for as far back as available). This data will be analyzed by ...
13
votes
3answers
4k views

Free market data (delayed or snapshot)

I know there are similar questions but I don't think there are any identical ones. Basically, I'm looking for one of these two things. Delayed market data feed. A tick by tick feed, but delayed by ...
-3
votes
2answers
732 views

Market Data For Project

I'm looking to find a service that will allow me to download historical data on stocks, bonds, options, futures, indices, etc and also to pick up new files either on a daily or weekly basis. I've been ...
45
votes
11answers
9k views

Innovative ways of visualizing financial data

Finance is drowning in a deluge of data. Humans are not very good at comprehending large amounts of data. One way out may be visualization. Traditional ways of visualizing patterns, complexities and ...
0
votes
0answers
53 views

Price variances on fixed income assets

New to the site. I am currently working on a project that involves analyzing two pricing sources (IDC and Markit) on fixed income assets (Corp, High Yield, Muni, and Structured). I am trying to ...
0
votes
0answers
65 views

Need 24 hours a day real time/slightly delayed prices of futures contracts on US and non-US [duplicate]

I'm looking for a data provider to get real-time/slightly delayed data for futures contracts on US and non-US indexes 24 hours a day. Can you recommend anything for a person, who can't afford ...
0
votes
0answers
43 views

Mapping Futures Data Into Mantas

Can anyone please help me figure out how to map 'Futures Data' into Oracle Mantas. I believe 'Futures Data Feed' will have a different 'Format' from the one acceptable to 'Mantas' risk management.
16
votes
6answers
4k views

Training set of tick-by-tick data?

I'm looking to find a free source of tick by tick data (<1sec) for training purposes. It doesn't need to be longer than a day, and I don't care what instrument, or exchange, or time it is. I just ...
3
votes
2answers
215 views

FIX/FAST packet analyzer

I have a network dump of market data in the FIX/FAST format (transported over UDP). Are there standard pieces of software (similar to Wireshark) that will parse and allow for inspection of the ...
1
vote
3answers
777 views

Is there a Bloomberg field for a bonds (upcoming) coupon dates?

For a specific bond I need to calculate the time until each of the upcoming cash flow payments (for obvious reasons). So I wondered if there is a field (bulk data) that gives me all the dates of the ...
0
votes
1answer
186 views

adjusted close prices on SP500

When I look at the adjusted close prices of SP500, for example, I notice that the numbers are always significantly below the actual closing. In the explanation of what adjusted prices are, one gets ...
3
votes
1answer
178 views

Deutsche Börse sample Level 2 data, how to view in Windows?

DB has some sample Level 2 market data: ...
0
votes
1answer
231 views

Where does CME store Security IDs for FIX messages?

Where does CME store Security IDs for FIX messages? I cannot find them anywhere? So given Security ID XX I can go and work out what product this actually is?
0
votes
0answers
199 views

CME historical option data provider

Is there any other historical end-of-day CME option data provider rather then CME DataMine? I've searched all the internet and found only CBOE traded options.
3
votes
1answer
150 views

Measuring and proxies for leverage in the financial system

It can be argued that the leverage - reflected by how much collateral people or firms need to put down to borrow and might lose if they fail to pay the loan back - used in the financial system is one ...
0
votes
0answers
514 views

fetch from yahoo! finance database - varying number of ticks

To test a model with real-life data, I used the fetch-function in matlab to connect to the database of yahoo! finance. My code to try and get 7 different assets' returns is the following: ...
0
votes
0answers
250 views

Fluid dynamics for order book depth modelling

Would someone be able to give me an idea what type of fluid dynamics I could look at for modelling the order book? My background is more signals-related maths (correlation, covariance, fourier etc). ...
1
vote
2answers
252 views

BSYM for historical tickers

When looking through Bloomberg's BSYM data ADR and Common Stock data (5/2/13), I was able to find the ticker symbol 'V' associated with Visa but was unable to find any record for Vivendi, which I ...
6
votes
2answers
2k views

Difference between google finance and yahoo finance?

I am wondering about the huge differences of the data provider google finance and yahoo finance. I am interested in the monthly data from adidas listed on xetra. In google: ETR:ADS and in yahoo ...
21
votes
8answers
10k views

How should I store tick data?

How should I store tick data? For example, if I have an IB trading account, how should I download and store the tick data directly to my computer? Which software should I use?
7
votes
2answers
1k views

Non-SQL methods for high-frequency accounting?

Does anyone know of any prior art for non-SQL data structures for high-frequency accounting, whether client, broker, or exchange-side? I'm thinking specifically of the problem of booking individual ...
3
votes
1answer
251 views

What is lagged interest rate?

I am trying to reproduce a plot in "Statistics and Data engineering for Financial Engineering" by D. Ruppert. The author uses the risk free returns data available in the Ecdat package in R. ...
7
votes
4answers
2k views

Best way to store hourly/daily options data for research purposes

There are quite a few discussions here about storage, but I can't find quite what I'm looking for. I'm in need to design a database to store (mostly) option data (strikes, premiums bid / ask, etc.). ...
15
votes
4answers
8k views

Usage of NoSQL storage in Finance

I am wondering if anyone has used NoSQL (mongodb, cassandra, etc.) to store and analyze data. I tried searching the web but was not able to see if the financial firms had gotten in to using nosql ...
2
votes
2answers
185 views

How to synchronize put and call option-data?

I recently retrieved a large amount of European option data, for call and put prices, from OptionMetrics. Doing so for the same time period I get a file consisting of 62558 rows of call prices & ...
3
votes
1answer
644 views

Get intraday data of SAP with google Finance

According to this link I try to get intraday data of SAP listed at Xetra. Intraday data with timestep of 1 second would be great. I do not understand parts of the command, I try ...
3
votes
1answer
285 views

Where can I get historical ticker change database?

There's 30 days worth of data at http://www.otcmarkets.com/marketActivity/symbol-changes - but I'm really looking for the past 10 years, or 5 years if only that is possible. Any dice? The closest ...
5
votes
0answers
420 views

option chain data visualization, sunburst

I think option chains are not represented in the best way. With more and more options products coming out and trading on the various exchanges, I see vendors struggling to keep up with a good way to ...
1
vote
0answers
186 views

Data feed that shows individual orders

Does anyone know how I can obtain time and sales data for a stock? Lots of feeds provide the total volume but I would like to see the breakdown of what buy/sell orders made up the day's volume. I ...
9
votes
2answers
306 views

Effective Euro-USD (EURUSD) Exchange Rate Prior to Euro's Existence

Motivation: I am running a quantitative analysis that requires long-term, exchange rate data. Problem: Does anyone have methods for dealing with the EURUSD exchange rate prior to the Euro's ...
12
votes
4answers
5k views

data on historical stock price of bankrupt companies

does anybody know a site where I can download historical data on stocks including companies that have gone bankrupt such as lehman brothers? it appears that bankrupt companies no longer appear in the ...
4
votes
1answer
261 views

time in time series database - UTC or local

I strictly store UTC time stamps inside time series files or databases, mainly to allow processing several time series together. Timezone information is kept with each time series file or item, so ...
3
votes
3answers
657 views

Generate tick data from candlestick

Is there software (or Python / R / ... scripts) to generate (pseudo) tick data from candlestick data. I have candlestick data (CSV format) from monthly timeframe (MN) to minute timeframe (M1) but ...
1
vote
2answers
604 views

Data feed API that uses REST?

Is there a data feed provider that has a REST (http) API? Preferably real-time and historical, at least for US equities.
6
votes
4answers
2k views

Analyzing tick data

What are some of the commonly used techniques to analyze tick data? I am looking at tick data to see how the quotes/ mid-price evolves due to certain events in the market. Since tick data is ...
2
votes
1answer
147 views

Historical data on short rates

I would like to backtest a short-equity strategy. I'm looking for historical data on the availability of shares and cost to short certain stocks. Does anyone know of such data being available ...
-1
votes
1answer
546 views

Is it possible to “steal” financial data on publicly traded companies off the internet? Legally, I mean, what is the truth about “data” as a property

What constitutes "stealing" when it comes to publicly posted financial data? I think there are three instances of this that we can individually vet: a.) you physically broke into a location or ...
1
vote
1answer
93 views

Generating Return Streams for stress testing

There is never enough market data for testing. And sampling from user defined distribution is a hotly debated subject as which distribution does the market really go with? There are many ways to ...
3
votes
1answer
320 views

mortgage prepayment model

I am trying to develop my own MBS prepayment model. I am confused by the terms SMM and CPR. Are they estimates/models in themselves or are they ACTUAL data for the MBS pool. where can I find actual ...
3
votes
1answer
308 views

Should I use SSAS to store Tick and bar data?

I have been looking for a low cost solution to effectively store and query tick and bar data. Databases like kdb+ and Streambase are too expensive for me. Building a custom solution with SSAS (Sql ...
4
votes
3answers
323 views

How do you handle Calendars in a .NET quant system?

I have developed an analytic platform in .NET, but I now have to tackle the problem of data cleaning which first starts by finding holes in time series, before actually looking to find inconsistent ...
1
vote
1answer
128 views

Brent Crude Data

I am trying to locate historical volatility data (5+ years) for Brent Crude? Does anyone know where I might be able to source such data?
1
vote
1answer
240 views

Normalized data

I am new to this. I trained and tested my data using SVM in Matlab with the autoscale option true => the data would be normalized with unit SD. Let's say the training data have the price around 200. ...
4
votes
1answer
2k views

Why use a column database for tick/bar data?

I often hear that column-oriented databases are the best choice method for storing time series data in finance applications. Especially by people selling expensive column-oriented databases. Yet, at ...