Questions about handling, obtaining, generating, or analyzing all types of financial or economic data.

learn more… | top users | synonyms

2
votes
1answer
472 views

Open source equity/bond index data

I have been using the tseries package of R (get.hist.quote) to get historical quotes for various indices from yahoo finance. I am interested in DAX, VDAX, EB.REXX ...
4
votes
2answers
1k views

Mass Market Data Source

My current project requires large amounts of historical and real-time market data (1m or 5m bars for various products, mostly US futures for as far back as available). This data will be analyzed by ...
13
votes
3answers
5k views

Free market data (delayed or snapshot)

I know there are similar questions but I don't think there are any identical ones. Basically, I'm looking for one of these two things. Delayed market data feed. A tick by tick feed, but delayed by ...
-3
votes
2answers
792 views

Market Data For Project

I'm looking to find a service that will allow me to download historical data on stocks, bonds, options, futures, indices, etc and also to pick up new files either on a daily or weekly basis. I've been ...
0
votes
0answers
66 views

Need 24 hours a day real time/slightly delayed prices of futures contracts on US and non-US [duplicate]

I'm looking for a data provider to get real-time/slightly delayed data for futures contracts on US and non-US indexes 24 hours a day. Can you recommend anything for a person, who can't afford ...
3
votes
2answers
318 views

FIX/FAST packet analyzer

I have a network dump of market data in the FIX/FAST format (transported over UDP). Are there standard pieces of software (similar to Wireshark) that will parse and allow for inspection of the ...
1
vote
3answers
2k views

Is there a Bloomberg field for a bonds (upcoming) coupon dates?

For a specific bond I need to calculate the time until each of the upcoming cash flow payments (for obvious reasons). So I wondered if there is a field (bulk data) that gives me all the dates of the ...
0
votes
1answer
260 views

adjusted close prices on SP500

When I look at the adjusted close prices of SP500, for example, I notice that the numbers are always significantly below the actual closing. In the explanation of what adjusted prices are, one gets ...
3
votes
1answer
186 views

Deutsche Börse sample Level 2 data, how to view in Windows?

DB has some sample Level 2 market data: ...
0
votes
1answer
335 views

Where does CME store Security IDs for FIX messages?

Where does CME store Security IDs for FIX messages? I cannot find them anywhere? So given Security ID XX I can go and work out what product this actually is?
0
votes
0answers
254 views

CME historical option data provider

Is there any other historical end-of-day CME option data provider rather then CME DataMine? I've searched all the internet and found only CBOE traded options.
3
votes
1answer
189 views

Measuring and proxies for leverage in the financial system

It can be argued that the leverage - reflected by how much collateral people or firms need to put down to borrow and might lose if they fail to pay the loan back - used in the financial system is one ...
0
votes
0answers
698 views

fetch from yahoo! finance database - varying number of ticks

To test a model with real-life data, I used the fetch-function in matlab to connect to the database of yahoo! finance. My code to try and get 7 different assets' returns is the following: ...
0
votes
0answers
280 views

Fluid dynamics for order book depth modelling

Would someone be able to give me an idea what type of fluid dynamics I could look at for modelling the order book? My background is more signals-related maths (correlation, covariance, fourier etc). ...
1
vote
2answers
363 views

BSYM for historical tickers

When looking through Bloomberg's BSYM data ADR and Common Stock data (5/2/13), I was able to find the ticker symbol 'V' associated with Visa but was unable to find any record for Vivendi, which I ...
21
votes
8answers
16k views

How should I store tick data?

How should I store tick data? For example, if I have an IB trading account, how should I download and store the tick data directly to my computer? Which software should I use?
7
votes
2answers
2k views

Non-SQL methods for high-frequency accounting?

Does anyone know of any prior art for non-SQL data structures for high-frequency accounting, whether client, broker, or exchange-side? I'm thinking specifically of the problem of booking individual ...
3
votes
1answer
378 views

What is lagged interest rate?

I am trying to reproduce a plot in "Statistics and Data engineering for Financial Engineering" by D. Ruppert. The author uses the risk free returns data available in the Ecdat package in R. ...
2
votes
2answers
214 views

How to synchronize put and call option-data?

I recently retrieved a large amount of European option data, for call and put prices, from OptionMetrics. Doing so for the same time period I get a file consisting of 62558 rows of call prices & ...
3
votes
1answer
1k views

Get intraday data of SAP with google Finance

According to this link I try to get intraday data of SAP listed at Xetra. Intraday data with timestep of 1 second would be great. I do not understand parts of the command, I try ...
3
votes
1answer
393 views

Where can I get historical ticker change database?

There's 30 days worth of data at http://www.otcmarkets.com/marketActivity/symbol-changes - but I'm really looking for the past 10 years, or 5 years if only that is possible. Any dice? The closest ...
5
votes
0answers
547 views

option chain data visualization, sunburst

I think option chains are not represented in the best way. With more and more options products coming out and trading on the various exchanges, I see vendors struggling to keep up with a good way to ...
1
vote
0answers
209 views

Data feed that shows individual orders

Does anyone know how I can obtain time and sales data for a stock? Lots of feeds provide the total volume but I would like to see the breakdown of what buy/sell orders made up the day's volume. I ...
10
votes
2answers
516 views

Effective Euro-USD (EURUSD) Exchange Rate Prior to Euro's Existence

Motivation: I am running a quantitative analysis that requires long-term, exchange rate data. Problem: Does anyone have methods for dealing with the EURUSD exchange rate prior to the Euro's ...
13
votes
4answers
5k views

data on historical stock price of bankrupt companies

does anybody know a site where I can download historical data on stocks including companies that have gone bankrupt such as lehman brothers? it appears that bankrupt companies no longer appear in the ...
4
votes
1answer
307 views

time in time series database - UTC or local

I strictly store UTC time stamps inside time series files or databases, mainly to allow processing several time series together. Timezone information is kept with each time series file or item, so ...
5
votes
3answers
880 views

Generate tick data from candlestick

Is there software (or Python / R / ... scripts) to generate (pseudo) tick data from candlestick data. I have candlestick data (CSV format) from monthly timeframe (MN) to minute timeframe (M1) but ...
1
vote
2answers
929 views

Data feed API that uses REST?

Is there a data feed provider that has a REST (http) API? Preferably real-time and historical, at least for US equities.
7
votes
4answers
4k views

Analyzing tick data

What are some of the commonly used techniques to analyze tick data? I am looking at tick data to see how the quotes/ mid-price evolves due to certain events in the market. Since tick data is ...
2
votes
1answer
160 views

Historical data on short rates

I would like to backtest a short-equity strategy. I'm looking for historical data on the availability of shares and cost to short certain stocks. Does anyone know of such data being available ...
-3
votes
1answer
658 views

Is it possible to “steal” financial data on publicly traded companies off the internet? Legally, I mean, what is the truth about “data” as a property

What constitutes "stealing" when it comes to publicly posted financial data? I think there are three instances of this that we can individually vet: a.) you physically broke into a location or ...
1
vote
1answer
94 views

Generating Return Streams for stress testing

There is never enough market data for testing. And sampling from user defined distribution is a hotly debated subject as which distribution does the market really go with? There are many ways to ...
3
votes
1answer
384 views

mortgage prepayment model

I am trying to develop my own MBS prepayment model. I am confused by the terms SMM and CPR. Are they estimates/models in themselves or are they ACTUAL data for the MBS pool. where can I find actual ...
3
votes
1answer
324 views

Should I use SSAS to store Tick and bar data?

I have been looking for a low cost solution to effectively store and query tick and bar data. Databases like kdb+ and Streambase are too expensive for me. Building a custom solution with SSAS (Sql ...
4
votes
3answers
382 views

How do you handle Calendars in a .NET quant system?

I have developed an analytic platform in .NET, but I now have to tackle the problem of data cleaning which first starts by finding holes in time series, before actually looking to find inconsistent ...
1
vote
1answer
135 views

Brent Crude Data

I am trying to locate historical volatility data (5+ years) for Brent Crude? Does anyone know where I might be able to source such data?
1
vote
1answer
250 views

Normalized data

I am new to this. I trained and tested my data using SVM in Matlab with the autoscale option true => the data would be normalized with unit SD. Let's say the training data have the price around 200. ...
3
votes
2answers
959 views

Tick data collection

I am new to this. I am confused on what consists of a tick data. I have a trading platform in which I could collect data of exchange traded product like futures and stocks. While I am intending to ...
10
votes
2answers
722 views

Why is the ratio of Hi-Low range to Open-Close range close to 2?

I tried it in several symbols and timeframes with the same result: $$\frac {mean(HIGH-LOW)}{mean(|CLOSE-OPEN|)}$$ ...
8
votes
3answers
964 views

Why isn't all market data free?

I am hoping any answers can be threaded somewhere between "don't be naive" and starting a quasi-political flame. Transparency is suppose to be good for markets and also a social good. The market ...
5
votes
1answer
1k views

Automated 10-K XBRL data grab using the SEC file structure

I would like to write a program that takes as input a list of CIK/year/quarter entries. The program should iterate through the list and, for each entry, grab XBRL financial data from the SEC website ...
3
votes
3answers
3k views

Monthly data for popular indices (constituents).

Trying to be concise: I am interested in the most popular indices (SP500, FTSE100, DAX30, CAC40, SMI30, etc). For each index I want to know its constituents in a monthly basis. For each constituent ...
6
votes
1answer
397 views

NASDAQ TotalView ITCH order reference number number characteristics

I am building a custom hash implementation for storing NASDAQ ITCH order messages. Obviously this is keyed on the order reference number and I am wondering if these numbers are sequential, random or ...
17
votes
2answers
3k views

Do you have historical tick data you want to donate?

Do you have historical market/pricing ticket data that you would like to donate to the Open Source Trader project (OST)?? Please: upload your files! Once we gather some data, we'll do our best to ...
10
votes
3answers
886 views

Literature on generating synthetic time series for testing

I have some market data (daily time series) for bond prices and CDS indices and I would like to generate synthetic versions of these which are statistically "similar" for testing trading strategies. ...
23
votes
5answers
7k views

What is a good broker for HFT?

Currently I trade trough IB. I run my HFT strategies (100 roundtrips per hour) but I think that latency is killing me and my profits are shrinking. I need the fastest possible brokers out there which ...
12
votes
3answers
6k views

R: How feasible is it to store — and work with — tick data in a database connected to R?

I'm looking to convert some tickdata .csv files into a database on a local disk and then use R to call the data and do my various analytics and modelling. What are some best practices / ...
8
votes
1answer
678 views

Where can I find data on the interbank lending market?

Where can I find disaggregated interbank lending data (i.e. bank A lends to bank B x money at y rate)? I could only find data on interest rates. I would accept LIBOR market data as well as any ...
2
votes
0answers
176 views

Can a higher P/E ratio be beneficial under certain circumstances? [closed]

I am new to investing. I understand that the P/E ratio along with other data can be used to determine whether a stock may or may not be undervalued. Are there situations where a HIGH P/E is actually ...
3
votes
2answers
286 views

Which indices to use for an equity vs. fixed-income portfolio simulation?

I want to backtest several basic optimization methods (e.g. MVO, "most-diversified portfolio"), and I want to do this on a basket of different asset indexes. To start with, I want to simulate a 60/40 ...