Questions about handling, obtaining, generating, or analyzing all types of financial or economic data.

learn more… | top users | synonyms

45
votes
11answers
8k views

Innovative ways of visualizing financial data

Finance is drowning in a deluge of data. Humans are not very good at comprehending large amounts of data. One way out may be visualization. Traditional ways of visualizing patterns, complexities and ...
0
votes
0answers
51 views

Price variances on fixed income assets

New to the site. I am currently working on a project that involves analyzing two pricing sources (IDC and Markit) on fixed income assets (Corp, High Yield, Muni, and Structured). I am trying to ...
0
votes
0answers
65 views

Need 24 hours a day real time/slightly delayed prices of futures contracts on US and non-US [duplicate]

I'm looking for a data provider to get real-time/slightly delayed data for futures contracts on US and non-US indexes 24 hours a day. Can you recommend anything for a person, who can't afford ...
0
votes
0answers
43 views

Mapping Futures Data Into Mantas

Can anyone please help me figure out how to map 'Futures Data' into Oracle Mantas. I believe 'Futures Data Feed' will have a different 'Format' from the one acceptable to 'Mantas' risk management.
16
votes
6answers
4k views

Training set of tick-by-tick data?

I'm looking to find a free source of tick by tick data (<1sec) for training purposes. It doesn't need to be longer than a day, and I don't care what instrument, or exchange, or time it is. I just ...
3
votes
2answers
190 views

FIX/FAST packet analyzer

I have a network dump of market data in the FIX/FAST format (transported over UDP). Are there standard pieces of software (similar to Wireshark) that will parse and allow for inspection of the ...
1
vote
3answers
629 views

Is there a Bloomberg field for a bonds (upcoming) coupon dates?

For a specific bond I need to calculate the time until each of the upcoming cash flow payments (for obvious reasons). So I wondered if there is a field (bulk data) that gives me all the dates of the ...
0
votes
1answer
171 views

adjusted close prices on SP500

When I look at the adjusted close prices of SP500, for example, I notice that the numbers are always significantly below the actual closing. In the explanation of what adjusted prices are, one gets ...
0
votes
0answers
30 views

How to visualize multi-dimensional data? [duplicate]

A few months back, I wrote a program that collects live statistics from various sources. My purpose was try to detect patterns in this data by looking at it several hours a day. After implementing and ...
0
votes
0answers
42 views

Find tick size and primary exchange for a given ticker [duplicate]

A rather elementary question here: I am looking at tick-by-tick data on mainly equities traded on American exchanges. But I don't have any data on the tick size and their primary exchange. Is ...
3
votes
1answer
175 views

Deutsche Börse sample Level 2 data, how to view in Windows?

DB has some sample Level 2 market data: ...
0
votes
1answer
198 views

Where does CME store Security IDs for FIX messages?

Where does CME store Security IDs for FIX messages? I cannot find them anywhere? So given Security ID XX I can go and work out what product this actually is?
0
votes
0answers
189 views

CME historical option data provider

Is there any other historical end-of-day CME option data provider rather then CME DataMine? I've searched all the internet and found only CBOE traded options.
3
votes
1answer
139 views

Measuring and proxies for leverage in the financial system

It can be argued that the leverage - reflected by how much collateral people or firms need to put down to borrow and might lose if they fail to pay the loan back - used in the financial system is one ...
0
votes
0answers
455 views

fetch from yahoo! finance database - varying number of ticks

To test a model with real-life data, I used the fetch-function in matlab to connect to the database of yahoo! finance. My code to try and get 7 different assets' returns is the following: ...
0
votes
0answers
240 views

Fluid dynamics for order book depth modelling

Would someone be able to give me an idea what type of fluid dynamics I could look at for modelling the order book? My background is more signals-related maths (correlation, covariance, fourier etc). ...
1
vote
2answers
237 views

BSYM for historical tickers

When looking through Bloomberg's BSYM data ADR and Common Stock data (5/2/13), I was able to find the ticker symbol 'V' associated with Visa but was unable to find any record for Vivendi, which I ...
6
votes
2answers
2k views

Difference between google finance and yahoo finance?

I am wondering about the huge differences of the data provider google finance and yahoo finance. I am interested in the monthly data from adidas listed on xetra. In google: ETR:ADS and in yahoo ...
21
votes
8answers
10k views

How should I store tick data?

How should I store tick data? For example, if I have an IB trading account, how should I download and store the tick data directly to my computer? Which software should I use?
7
votes
2answers
1k views

Non-SQL methods for high-frequency accounting?

Does anyone know of any prior art for non-SQL data structures for high-frequency accounting, whether client, broker, or exchange-side? I'm thinking specifically of the problem of booking individual ...
3
votes
1answer
229 views

What is lagged interest rate?

I am trying to reproduce a plot in "Statistics and Data engineering for Financial Engineering" by D. Ruppert. The author uses the risk free returns data available in the Ecdat package in R. ...
7
votes
4answers
1k views

Best way to store hourly/daily options data for research purposes

There are quite a few discussions here about storage, but I can't find quite what I'm looking for. I'm in need to design a database to store (mostly) option data (strikes, premiums bid / ask, etc.). ...
14
votes
4answers
7k views

Usage of NoSQL storage in Finance

I am wondering if anyone has used NoSQL (mongodb, cassandra, etc.) to store and analyze data. I tried searching the web but was not able to see if the financial firms had gotten in to using nosql ...
2
votes
2answers
178 views

How to synchronize put and call option-data?

I recently retrieved a large amount of European option data, for call and put prices, from OptionMetrics. Doing so for the same time period I get a file consisting of 62558 rows of call prices & ...
3
votes
1answer
559 views

Get intraday data of SAP with google Finance

According to this link I try to get intraday data of SAP listed at Xetra. Intraday data with timestep of 1 second would be great. I do not understand parts of the command, I try ...
3
votes
1answer
275 views

Where can I get historical ticker change database?

There's 30 days worth of data at http://www.otcmarkets.com/marketActivity/symbol-changes - but I'm really looking for the past 10 years, or 5 years if only that is possible. Any dice? The closest ...
5
votes
0answers
392 views

option chain data visualization, sunburst

I think option chains are not represented in the best way. With more and more options products coming out and trading on the various exchanges, I see vendors struggling to keep up with a good way to ...
1
vote
0answers
185 views

Data feed that shows individual orders

Does anyone know how I can obtain time and sales data for a stock? Lots of feeds provide the total volume but I would like to see the breakdown of what buy/sell orders made up the day's volume. I ...
9
votes
2answers
275 views

Effective Euro-USD (EURUSD) Exchange Rate Prior to Euro's Existence

Motivation: I am running a quantitative analysis that requires long-term, exchange rate data. Problem: Does anyone have methods for dealing with the EURUSD exchange rate prior to the Euro's ...
12
votes
4answers
4k views

data on historical stock price of bankrupt companies

does anybody know a site where I can download historical data on stocks including companies that have gone bankrupt such as lehman brothers? it appears that bankrupt companies no longer appear in the ...
4
votes
1answer
252 views

time in time series database - UTC or local

I strictly store UTC time stamps inside time series files or databases, mainly to allow processing several time series together. Timezone information is kept with each time series file or item, so ...
3
votes
3answers
619 views

Generate tick data from candlestick

Is there software (or Python / R / ... scripts) to generate (pseudo) tick data from candlestick data. I have candlestick data (CSV format) from monthly timeframe (MN) to minute timeframe (M1) but ...
1
vote
2answers
552 views

Data feed API that uses REST?

Is there a data feed provider that has a REST (http) API? Preferably real-time and historical, at least for US equities.
6
votes
4answers
2k views

Analyzing tick data

What are some of the commonly used techniques to analyze tick data? I am looking at tick data to see how the quotes/ mid-price evolves due to certain events in the market. Since tick data is ...
2
votes
1answer
145 views

Historical data on short rates

I would like to backtest a short-equity strategy. I'm looking for historical data on the availability of shares and cost to short certain stocks. Does anyone know of such data being available ...
-1
votes
1answer
526 views

Is it possible to “steal” financial data on publicly traded companies off the internet? Legally, I mean, what is the truth about “data” as a property

What constitutes "stealing" when it comes to publicly posted financial data? I think there are three instances of this that we can individually vet: a.) you physically broke into a location or ...
1
vote
1answer
93 views

Generating Return Streams for stress testing

There is never enough market data for testing. And sampling from user defined distribution is a hotly debated subject as which distribution does the market really go with? There are many ways to ...
3
votes
1answer
311 views

mortgage prepayment model

I am trying to develop my own MBS prepayment model. I am confused by the terms SMM and CPR. Are they estimates/models in themselves or are they ACTUAL data for the MBS pool. where can I find actual ...
3
votes
1answer
303 views

Should I use SSAS to store Tick and bar data?

I have been looking for a low cost solution to effectively store and query tick and bar data. Databases like kdb+ and Streambase are too expensive for me. Building a custom solution with SSAS (Sql ...
4
votes
3answers
317 views

How do you handle Calendars in a .NET quant system?

I have developed an analytic platform in .NET, but I now have to tackle the problem of data cleaning which first starts by finding holes in time series, before actually looking to find inconsistent ...
1
vote
1answer
127 views

Brent Crude Data

I am trying to locate historical volatility data (5+ years) for Brent Crude? Does anyone know where I might be able to source such data?
1
vote
1answer
239 views

Normalized data

I am new to this. I trained and tested my data using SVM in Matlab with the autoscale option true => the data would be normalized with unit SD. Let's say the training data have the price around 200. ...
4
votes
1answer
2k views

Why use a column database for tick/bar data?

I often hear that column-oriented databases are the best choice method for storing time series data in finance applications. Especially by people selling expensive column-oriented databases. Yet, at ...
3
votes
2answers
783 views

Tick data collection

I am new to this. I am confused on what consists of a tick data. I have a trading platform in which I could collect data of exchange traded product like futures and stocks. While I am intending to ...
10
votes
2answers
674 views

Why is the ratio of Hi-Low range to Open-Close range close to 2?

I tried it in several symbols and timeframes with the same result: $$\frac {mean(HIGH-LOW)}{mean(|CLOSE-OPEN|)}$$ ...
8
votes
3answers
803 views

Why isn't all market data free?

I am hoping any answers can be threaded somewhere between "don't be naive" and starting a quasi-political flame. Transparency is suppose to be good for markets and also a social good. The market ...
5
votes
1answer
759 views

Automated 10-K XBRL data grab using the SEC file structure

I would like to write a program that takes as input a list of CIK/year/quarter entries. The program should iterate through the list and, for each entry, grab XBRL financial data from the SEC website ...
3
votes
3answers
2k views

Monthly data for popular indices (constituents).

Trying to be concise: I am interested in the most popular indices (SP500, FTSE100, DAX30, CAC40, SMI30, etc). For each index I want to know its constituents in a monthly basis. For each constituent ...
6
votes
1answer
372 views

NASDAQ TotalView ITCH order reference number number characteristics

I am building a custom hash implementation for storing NASDAQ ITCH order messages. Obviously this is keyed on the order reference number and I am wondering if these numbers are sequential, random or ...
16
votes
2answers
2k views

Do you have historical tick data you want to donate?

Do you have historical market/pricing ticket data that you would like to donate to the Open Source Trader project (OST)?? Please: upload your files! Once we gather some data, we'll do our best to ...