Questions tagged [data]

Questions about handling, obtaining, generating, or analyzing all types of financial or economic data.

Filter by
Sorted by
Tagged with
0
votes
1answer
55 views

Mean Variance optimization on hourly data with gaps

I'm building a mean variance optimizer for a portfolio of FX, commodity and bond futures. The input data is hourly returns for each underlying. Given each underlying has different market opening hours,...
1
vote
4answers
1k views

Data sources for financials of global equities

I looked through the master list of data sources but could not find any data sources for financial data of global equities. An example would be the balance sheet of, say, ...
3
votes
2answers
738 views

Market data for options

Looking for recommendations on places to get market data for options. I'm looking at NYSE and NASDAQ only. My current solution is my broker, Tradeking. I can request realtime data for 700 option ...
2
votes
3answers
126 views

Profits of US Banks

Are there any publicly available data on [aggregate] profits for domestic US banks, especially quarterly data? Most studies that I know use the "Financial Statements of Banks" from the OECD but these ...
8
votes
3answers
2k views

Automated 10-K XBRL data grab using the SEC file structure

I would like to write a program that takes as input a list of CIK/year/quarter entries. The program should iterate through the list and, for each entry, grab XBRL financial data from the SEC website ...
0
votes
0answers
32 views

Data request: Option prices for a liquid index/stock

Currently doing a course project on option pricing as a part of my undergraduate studies. However I cannot find a free dataset $D=[d_1,d_2,...,d_N]$, which would represent a time-serie of daily option ...
1
vote
2answers
80 views

Datasource of all scheduled news events for S&P 500 stocks

I am looking for a datasource which contains all news events specific to equities of the S&P 500, whose release date was scheduled in advance. That is, I am not looking for surprise news. For ...
1
vote
1answer
176 views

Are Kenneth French Research Returns log-Returns?

Does anyone know if Kenneth French's return data on his website is log returns?
1
vote
2answers
1k views

Are there any free data of DAX or DAX future in 1-second or 1-minute time resolution?

Are there any free data of DAX or DAX future in 1-second or 1-minute time resolution ? I would be happy to buy them but everywhere prices starts from 1k $ (minimum value of order), 2016 alone would be ...
0
votes
2answers
79 views

Imputation of missing returns

I'm trying to calculate a historical VaR for a portfolio of futures, however there are certain days for which some assets are missing prices. Since the portfolio consists of many spread positions, the ...
7
votes
3answers
6k views

Why the difference between SPY and ^GSPC?

Look at SPY vs ^GSPC -- the difference seems bigger than can be explained by the ETF fees. Is it only because of SPY re-invests dividends quarterly or something else? Since ...
0
votes
1answer
211 views

Bloomberg's Open Market Data Initiative

I am reading about OMDI: https://www.bloomberg.com/company/announcements/bloomberg-opens-its-data-distribution-technology/ After reading that, I am still not sure: Is it free? If so, what kind of ...
0
votes
0answers
25 views

Collateralized Bond Obligations History

Collateralized Bond Obligations (CBOs) were a form of CDOs that were more popular in the early 2000s. I am looking for: Historical loss rates on their tranches (if available) Whether historically any ...
0
votes
0answers
98 views

Credit Default Swap transaction data

I'm looking for historical transaction data for (OTC) Credit Default Swaps. One option is to take a look on DTCC Data: http://www.dtcc.com/repository-otc-data.aspx Are there other options to get the ...
0
votes
1answer
39 views

Kenneth Frenches Data library return data to price data?

I have downloaded the industry portfolios from Kenneth Frenches data library, I am wondering if anyone knows where I can find the price data? Can I convert it even if I don't have a starting value? ...
4
votes
3answers
3k views

Source for real-time tick data (stock price, etc.) updated every second?

For educational purposes, I'm looking for a source for now's real-time tick data for stock prices, or FOREX, etc., with a 1 second precision. Is there such free data feed? If not, could such data be ...
2
votes
3answers
2k views

Data feed API that uses REST?

Is there a data feed provider that has a REST (http) API? Preferably real-time and historical, at least for US equities.
3
votes
1answer
72 views

How to obtain data for Benford's Law analysis?

First off, let me be specific as to what I mean by "Benford's Law analysis": I'm looking to test, given some data, if the set of first significant digits are independent, identically distributed ...
4
votes
1answer
125 views

Portfolio optimization with changing portfolio constituents

Say I have time series data for $N$ assets, where for the longest existing asset I have data from $t_0=0$ to $T$, but for several other assets I only have data from say $t_0+k$ to $t_0+l$ for some $0&...
-1
votes
2answers
193 views

What are some simple, free/affordable methods to obtain a spreadsheet of selected columns for a comma separated list of publicly traded stocks?

For example, if I wanted to compare a list of equities inside of a very small segment of the global economy (say, the members of the Emerging AgroSphere ETF) I'd want to know their full names, their ...
1
vote
1answer
77 views

Simulating trading strategies

I want to simulate real time trading strategies. For simplicity, let's say I only want to simulate a long-only portfolio on S&P500. I have a couple of questions: Is there a place online where ...
0
votes
1answer
437 views

How to deal with missing value in a time series stock market data?

I have collected data for the period of 2002 to 2018 for following indices Nifty (India), NASDAQ (US), ADX (UAE) and TASI (Saudi Arabia). After collection, I have arranged data in a single sheet with ...
2
votes
2answers
112 views

How do I calculate bad debt on revolving credit?

I have a revolving credit system. A customer purchases and then has 6 months to pay off the purchase. i.e. Purchase for 60 in Jan and then need to pay 10 a month in Feb, Mar, Apr, May, Jun, Jul. The ...
3
votes
1answer
152 views

Data sources for historical Eurex settlement option prices

I am looking for long history for historical settlement option prices at EUREX. This seems to be more challenge than I could imagine. Eurex themselves doesn't offer that data unfortunately (they only ...
1
vote
0answers
26 views

Identifying primary share class of U.S. firms and deleting excess observations

I have a fairly large dataset of CRSP firms with their daily closing prices from 2006 till 2017. I need to filter the data so that I have one daily observation per unique firm. I've identified the ...
14
votes
8answers
23k views

Data source for historical Share Outstanding totals for individual stocks?

Data is normally adjusted for splits/reverse splits, etc. The current shares outstanding is usually available. Is there a data repository that captures the shares outstanding for any point in the ...
4
votes
1answer
197 views

I am looking for a list of all companies worldwide with their annual revenue

I am trying to find a list of all publicly traded companies worldwide along with their annual revenue. I can get the list of stock symbols but is there a way to get their annual revenue without ...
2
votes
1answer
70 views

Downloading historical data of “Financial Account Data”

I would like to know how to download historical data from www.federalreserve.gov/apps/fof/FOFTables.aspx Please advise.
1
vote
1answer
653 views

Automatically get iShares ETF holdings

I heard that ETF's must publicly report their holdings all the time. I have seen that for example on the iShares website I can download the list of holdings as a csv file: https://www.ishares.com/us/...
0
votes
0answers
33 views

Bond Data on UK corporate

I have got data from FRED on Moody's Seasoned Aaa Corporate Bond Yield. Does anyone know where I can get such UK data on this? If not, would using exchange rates and the interest rate parity theorem ...
2
votes
2answers
424 views

Classifying stocks by industry (free)

Is there anyway to get the stock symbols of an exchange classified by industry? For example: AMD-semiconductor The best I could find was this page: https://money.cnn.com/data/sectors/tech/electronic/...
4
votes
0answers
148 views

Match different option high frequency databases

I downloaded the “E-mini S&P 500 (Dollar) Options for 1/10/11” Top-of-Book (BBO) data. If you are interested you may download the data from the following link (approx. 80MB zipped and 1GB unzipped)...
2
votes
0answers
25 views

Mapping international firms in I/B/E/S to Compustat

Follow up to my previous question on how to map I/B/E/S to Compustat. A big chunk of firms in both Compustat and I/B/E/S failed to map via CRSP for me. After some investigation, I noticed that they ...
0
votes
1answer
70 views

Subset selection to identify independent variables that impact the market?

Given a lot of market-related features (~100 independent variables such as emerging market, developed market, s&p 500, tech sector returns, etc), I need to select a subset of them that are ideally ...
47
votes
5answers
22k views

Building Financial Data Time Series Database from scratch

My company is starting a new initiative aimed at building a financial database from scratch. We would be using it in these ways: Time series analysis of: a company's financial data (ex: IBM's total ...
3
votes
1answer
366 views

how to treat NA values in Compustat and CRSP

In some years, some accounting values of some companies are missing in Compustat and CRSP. How do I treat those missing values ? Should I replace those with zeros or just simply delete years in which ...
0
votes
1answer
142 views

(Self studying) Finding data on Bloomberg

I apologize for asking this very simple question, but I was reading through this chart for the first time, and I would like to know where on Bloomberg can I find data like these, since I have to price ...
1
vote
0answers
31 views

amount of data - option pricer calibration

A practical question. When you calibrate an option pricer (whatever the model is), do you use data from several days or just one day (last trading day)? I noted some papers use data from one single ...
2
votes
2answers
738 views

Mapping I/B/E/S to Compustat via 6-digit CUSIP

I am trying to link Thomson Reuter's I/B/E/S dataset with Compustat. Both I obtained via WRDS. The only halfway useful info I could find was on a two year old forum post, which suggests to go through ...
1
vote
0answers
47 views

How to handle database updates for splits/dividends?

I'm finding it an difficult task to maintain a database of stock prices. My main problem is how to efficiently handle splits and dividends. Is it better to handle this in a database with adjusted ...
0
votes
3answers
449 views

Appropriate way to normalize Bollinger Bands?

I am playing around with using neural nets to make predictions on market trends. I am currently feeding in a portfolio of historical data of many stocks, and am now implementing several technical ...
4
votes
5answers
3k views

Where to find historical stock news and other events?

So, I am working on a strategy that has pin-pointed some very interesting events in the form of extremely low volatility. The phenomena spans the past few years and a wide variety of symbols. Now, to ...
0
votes
1answer
343 views

Data: to clean or not to clean

From risk management point of view using cleaned data (excluding or modifying extreme/outlier observations) would give less conservative measure as compared to real-world raw data. So they are more ...
3
votes
1answer
3k views

Where can I find open swaption implied volatility data?

Anyone have a good place to find interest rate swaption implied volatility data? Does Bloomberg's python API allow access?
83
votes
13answers
17k views

Innovative ways of visualizing financial data

Finance is drowning in a deluge of data. Humans are not very good at comprehending large amounts of data. One way out may be visualization. Traditional ways of visualizing patterns, complexities and ...
1
vote
1answer
105 views

Dividend Yield Goyal and Welch (2008)

Following the Goyal and Welch (2008) stock return predictability data, does anyone know how they calculate the dividend yield from the dataset that they provide on Amit Goyals website http://www.hec....
0
votes
1answer
128 views

Where can I find historical data for Europe listed ETFs?

I'm currently working on building a portfolio optimization tool for European ETFs such as: (SYMBOL/ISIN/description) IQQF / IE00B0M63730 / iShares MSCI AC Far East ex-Japan UCITS ETF EXW1 / ...
13
votes
4answers
12k views

How to get list of all CUSIPS/ISIN?

I want a list of all CUSIPs/ISINs. It would be nice if they were also categorized (e.g. Bonds/Funds etc). Where can I get such a data?
0
votes
1answer
286 views

Download bond yields R

I need to download bonds yields using R. I tried, as usual, I did for stocks: spc <- new.env() setDefaults(getSymbols,src="FRED") getSymbols("^AT0000386198", env = spc, from = "2010-01-01", to =...
1
vote
0answers
40 views

Transform 24hr cumulative volume to sampled periods

I have a Python Dataframe with cryptocurrency data that has three columns: time, 24hr volume and price. The time is the time at which the data was received from the exchange, price is the last price ...