Questions tagged [data]

Questions about handling, obtaining, generating, or analyzing all types of financial or economic data.

10
votes
0answers
1k views

option chain data visualization, sunburst

I think option chains are not represented in the best way. With more and more options products coming out and trading on the various exchanges, I see vendors struggling to keep up with a good way to ...
8
votes
0answers
348 views

What is the most convenient data structure for backtesting a model of futures options prices?

I have an empirical model for the dynamics of futures prices in a particular market that I have implemented using a long series of the front five contracts. (I account for the roll in my model.) I ...
4
votes
0answers
143 views

Match different option high frequency databases

I downloaded the “E-mini S&P 500 (Dollar) Options for 1/10/11” Top-of-Book (BBO) data. If you are interested you may download the data from the following link (approx. 80MB zipped and 1GB unzipped)...
3
votes
0answers
628 views

Replacement for Moodys BAA and AAA series

Along with many other people, I have been using Moody's seasoned BAA and AAA corporate bond yield series for my research for some time. I use them primarily to compute and analyze the quality spread. ...
2
votes
0answers
23 views

Mapping international firms in I/B/E/S to Compustat

Follow up to my previous question on how to map I/B/E/S to Compustat. A big chunk of firms in both Compustat and I/B/E/S failed to map via CRSP for me. After some investigation, I noticed that they ...
2
votes
0answers
87 views

FTSE 350 sector index historical data

Does anyone know where I can find (at least 10 years worth of) end of day historical (op, hi, lo, cl) data for the FTSE 350 Sector Indices?. I need the data for ...
2
votes
0answers
51 views

Is there any research available on profile of the market participants in different markets?

I know markets are by large anonymous, is there any current research or data sources publicly available across different exchanges and/or investment instruments on the profiles of their investors? I ...
2
votes
0answers
138 views

How to reset indicators in quantstrat / quantmod?

I am currently trying to back test a strategy on a file which contains minutely data for the whole month. I would like to reset my indicators at 3:30 PM . Is there a way I can reset the indicators ...
2
votes
0answers
558 views

Advice on linking DUNS to GVKEY

I'm working with US Government procurement contracts and I'm like to merge the contract data with stock data from CRSP and firm fundamentals from Compustat. The contract data uses the Dun & ...
2
votes
0answers
54 views

How to get swap reporting data from repositories ICE and CME?

Bloomberg and DTCC both release swap reporting data in form of downloadable files which can be analyzed later on. I have been looking for the same on ICE and CME sites, but couldn't find. How can I ...
2
votes
0answers
118 views

Equity Index Announcement Data

Does anyone know of a data source that provides announcements of future index events (adds/drops/re-balances), specifically for equity indexes? I know these are mostly available somewhere on each ...
2
votes
0answers
305 views

Data source for a corporate bond yield curve?

Yield curves are a valuable tool for economic analysis. It is particularly interesting to analyse the difference between Government Debt yields and Corporate Debt yields (credit spreads). This gives ...
2
votes
0answers
53 views

Time between end of use of ticker symbol by one company and beginning of use by another?

I have a CRSP stock dataset that goes up to december 2013. I'm trying to append yahoo finance data to it in order to bring it up to the current day. However, there are ticker symbols that once ...
2
votes
0answers
90 views

Historical list of Primary Dealers in Europe

I would be interested in a list of all the banks and financial institutions that have been Primary Dealers in the European Union from the 1980s until today. For a current list you can check this pdf ...
2
votes
0answers
47 views

what kind of test for volatility and where find the data

I am working on a model for stochastic volatility. In short, the model try to capture that the volatility goes up suddenly after a shock (war, policy, financial events, etc) and then goes down slowly, ...
2
votes
0answers
1k views

fetch from yahoo! finance database - varying number of ticks

To test a model with real-life data, I used the fetch-function in matlab to connect to the database of yahoo! finance. My code to try and get 7 different assets' returns is the following: ...
2
votes
0answers
371 views

Fluid dynamics for order book depth modelling

Would someone be able to give me an idea what type of fluid dynamics I could look at for modelling the order book? My background is more signals-related maths (correlation, covariance, fourier etc). ...
2
votes
0answers
249 views

Data feed that shows individual orders

Does anyone know how I can obtain time and sales data for a stock? Lots of feeds provide the total volume but I would like to see the breakdown of what buy/sell orders made up the day's volume. I ...
1
vote
0answers
26 views

Identifying primary share class of U.S. firms and deleting excess observations

I have a fairly large dataset of CRSP firms with their daily closing prices from 2006 till 2017. I need to filter the data so that I have one daily observation per unique firm. I've identified the ...
1
vote
0answers
30 views

amount of data - option pricer calibration

A practical question. When you calibrate an option pricer (whatever the model is), do you use data from several days or just one day (last trading day)? I noted some papers use data from one single ...
1
vote
0answers
44 views

How to handle database updates for splits/dividends?

I'm finding it an difficult task to maintain a database of stock prices. My main problem is how to efficiently handle splits and dividends. Is it better to handle this in a database with adjusted ...
1
vote
0answers
39 views

Transform 24hr cumulative volume to sampled periods

I have a Python Dataframe with cryptocurrency data that has three columns: time, 24hr volume and price. The time is the time at which the data was received from the exchange, price is the last price ...
1
vote
0answers
126 views

Any databases with CEO letters and shareholder letters?

I am researching disclosures on CEO letters and Shareholder letters present in annual reports of listed companies in the London Stock Exchange. Can someone recommend a database where the annual ...
1
vote
0answers
169 views

List of US Industry sector ETFs that map to ICB classification

I am in the prcess of carrying out intra-and intra sector analysis of US stocks, and am proxing sectors with sector ETFs. I therefore, need to catalog the list of US sector ETFs - but have been unable ...
1
vote
0answers
92 views

Winsorization and Standardization in data manipulation

Suppose there are two time series of data, ask price and bid price in options. They are used to calculate bid-ask spread($\frac{P_A-P_B}{P_{Mid}}$). I attempt to use winsorization and ...
1
vote
0answers
252 views

What symbols to use on Google Finance and Yahoo finance OMX30

I want to download historical data using pandas_datareader for OMX30, however I cant find any symbol which can be found using pandas_datareader. For example: STO:...
1
vote
0answers
480 views

Commodity index member weights (historical) for S&P GSCI and BCOM

Does anyone know a datasource for retrieving the historical index member weights for the two major commodity indices S&P GSCI and Bloomberg Commodity Index? My institution provides access to ...
1
vote
0answers
1k views

Map CUSIP to CIK

I'm trying to analyse 13F filings and those provide CUSIPs and names. I hoped the names would be sufficient to find the relevant Edgar filings but the names are often imprecise (e.g., "ABBOTT LABS" ...
1
vote
0answers
46 views

How to reduce data dependence for empirically assessing option pricing model performance?

I am preparing a paper about mitigating assessment failures for option pricing models. For the sake of simpliciy, suppose we are talkin about European options. In basic terms, what I would like to say ...
1
vote
0answers
49 views

Distribution of loans by types of interest

Im looking for some kind of report that would inculde data on the distribution of corporate loans by types of interest(fixed/floating), specifically global not just for one country(developed, ...
1
vote
0answers
55 views

Are there data sets for the topology of financial assets?

There have been a number of articles talking about financial topology and understanding cascading failures and risk. A while back there was another article about how a small number of companies form ...
1
vote
0answers
162 views

Is there a public SQL database for all US stocks?

I would like to search through all US stocks (via SQL or another technology), and filter them by certain parameters (similar to a stock screener, but through an API rather than a user interface). Is ...
1
vote
0answers
110 views

Intraday return and volatility figures some sense check

Some questions about intraday returns and volatility figures. It is with the objective of sense checking. Firstly, for Security A, I am calculating the five minute interval return numbers over 29500 ...
1
vote
0answers
60 views

What is a good statistical test on stock prices to indicate a company's value has changed?

My current test is to take monthly proportional price changes for stock XYZ and subtract out the proportional changes of the S&P500. Then compare the mean of a sample of XYZ-S&P (e.g. trailing ...
1
vote
0answers
34 views

Feedback on Video Metadata Extraction

I've developed/patented a metadata extraction methodology, which we've used to build a variety of alternative datasets for funds. One of the more difficult issues in this field, is getting useful ...
1
vote
0answers
90 views

Problem with overlapping data when testing futures market efficiency

In my case non-overlapping data would represent the scenario where futures prices (3 months) do not correspond to the futures spot prices in terms of delivery date. For example, futures settlement ...
1
vote
0answers
53 views

Data on interest rate differentials (lending on own vs. foreign currency)

I'm looking for data on (inner country) interest rate differentials between lending in own and foreign currency. Is there any data publicly available? If yes, where? If not, which non-free sources are ...
1
vote
0answers
110 views

Where can I find bonds time series?

I want to study dependence and correlation between bonds and CDS. I have already found a large CDS database of time series there: www.datagrapple.com I am looking for such a similar database (with an ...
1
vote
0answers
52 views

BLS v2 API took 20+ minutes to publish data where is immediate data available?

First, I should state that I built a Java program that uses HTTP Components to keep in sync with server time for my broker. Once 7:29:59 comes around the program ...
1
vote
0answers
25 views

Sample data of quarterly (annualized) real GDP growth

I am looking for a database that provides me the quarterly (annualized) real GDP growth (quarter t and t-1) of US, Germany and England. For the US data i went here: https://www.philadelphiafed.org/...
1
vote
0answers
40 views

Historical UK Gilt 2-year and 5-year data

Data on the Medium (approx. 5-years) and Short (approx. 2-years) futures contract listed on ICE only goes back to 2009. Is anyone able to point me towards where I can get a longer time series, perhaps ...
1
vote
0answers
182 views

ISM PMI data - sector trend through ranking and seasonal decomposition

I have monthly data for each of the 18 sectors in the ISM PMI. Each datapoint shows the trend of a sector: growing, contracting or neutral. It also tells the strength of that trend with a number: "...
1
vote
0answers
594 views

What is the algorithm for the Fama-Bliss instrument selection?

Fama-Bliss discount bonds are defined through a straight forward calculation (Famma, Bliss 1987). For the purposes of a project I need to derive forward rates, yields &c. for periods not included ...
0
votes
0answers
19 views

Data Vendors for Equity Risk Premium, Risk Free Rate and Equity Index Price

I've been searching to see if there are vendors that could provide datasets for these 3 categories. Any recommendations? Thanks
0
votes
0answers
33 views

How to work with vine copula in R?

I have returns of 4 stocks: stock1, stock2, stock3, stock4. And I use R and library(VineCopula) to do: ...
0
votes
0answers
47 views

API returning company tickers found in provided news article

I'm looking for a REST API (paid or free) that accepts a string containing a news article (example below) as payload and returns an array of company tickers (eg TSLA for Tesla) mentioned in the ...
0
votes
0answers
18 views

Termstrc data preparation from Bloomberg terminal

I am trying to use the R package termstrc to estimate yield curves for the Czech Republic. I have found the structure of the required class ...
0
votes
0answers
31 views

Data request: Option prices for a liquid index/stock

Currently doing a course project on option pricing as a part of my undergraduate studies. However I cannot find a free dataset $D=[d_1,d_2,...,d_N]$, which would represent a time-serie of daily option ...
0
votes
0answers
24 views

Collateralized Bond Obligations History

Collateralized Bond Obligations (CBOs) were a form of CDOs that were more popular in the early 2000s. I am looking for: Historical loss rates on their tranches (if available) Whether historically any ...
0
votes
0answers
95 views

Credit Default Swap transaction data

I'm looking for historical transaction data for (OTC) Credit Default Swaps. One option is to take a look on DTCC Data: http://www.dtcc.com/repository-otc-data.aspx Are there other options to get the ...