Podcast #128: We chat with Kent C Dodds about why he loves React and discuss what life was like in the dark days before Git. Listen now.

Questions tagged [data]

Questions about handling, obtaining, generating, or analyzing all types of financial or economic data.

Filter by
Sorted by
Tagged with
2
votes
1answer
50 views

ETF performance/returns

I was going over some ETF return data on yahoo finance and encountered some numbers that did not make sense to me. The image below shows a ytd return of 17.94% and 13.52%. I checked ETF.com and ETFdb ...
5
votes
1answer
288 views

Volume or Dollar bars vs. volatility normalized and demeaned financial time series

In his book - Advances in Financial Machine Learning, Marcos Lopez de Prado familiarises the reader with a number of ways of normalizing our financial time series data. Below I provide a couple of ...
10
votes
2answers
4k views

Is Yahoo! Finance data good or bad now?

I have read various blog posts and reddit threads and so on talking about the recent changes to the Yahoo! Finance API and it leaves me very confused. I'm confused about what has changed. Supposedly ...
2
votes
1answer
80 views
0
votes
0answers
25 views

Where can I get large dataset [duplicate]

Where can I get large unbiased dataset for all stocks in the world (and not just the historical price but also the balance sheets fact and ratios). By unbiased I mainly mean to: 1. not being ...
3
votes
4answers
5k views

Place to get free live Forex quotes via API?

Are any free Forex data APIs available? There are a ton of historical data repositories that are freely available but what about a live, streaming data API? 1 minute updates or tick data would be ...
2
votes
1answer
102 views

Data: Why is a firm stock delisted?

Shumway (1997) highlights that stock returns in cross-sectional portfolio analysis have to be adjusted for firm delistings. The CRSP database maintains a monthly delisting file (msedelist) with ...
0
votes
0answers
24 views

Termstrc data preparation from Bloomberg terminal

I am trying to use the R package termstrc to estimate yield curves for the Czech Republic. I have found the structure of the required class ...
45
votes
4answers
5k views

How much data is needed to validate a short-horizon trading strategy?

Suppose one has an idea for a short-horizon trading strategy, which we will define as having an average holding period of under 1 week and a required latency between signal calculation and execution ...
0
votes
3answers
978 views

Looking for free historical EOD prices of stocks from S&P 500

I'm trying to build a database of historical stock EOD price data with no survivorship bias, primarily from the S&P 500. I have looked through numerous data sources from this website to create a ...
1
vote
1answer
118 views

Which data provider do you recommend? [duplicate]

i need to run optimization models and backtests on developed market equities. I have access to Refinitivs Eikon, but it doesnt have a backtest tool and downloading the data is a challenge on his own. ...
1
vote
1answer
199 views

Loan Level Data for Residential Mortgage Backed Securities

I'm looking for loan level detail for Residential Mortgage Backed Securities. The SEC requires that form ABS-EE (individual level asset data) be filed for all offerings backed by residential ...
1
vote
1answer
55 views

What preprint repositories are available online?

Besides data sources, what preprint archives are available for academics and practitioners in the fields of Quantitative Finance and Economics? I have subscribed Google Scholar alerts and regularly ...
8
votes
0answers
369 views

What is the most convenient data structure for backtesting a model of futures options prices?

I have an empirical model for the dynamics of futures prices in a particular market that I have implemented using a long series of the front five contracts. (I account for the roll in my model.) I ...
8
votes
2answers
1k views

Why don't data sources use ISIN instead of symbol?

I've been messing around with stock data off and on for a year or two and just recently found out about the ISIN. Up until I found some data from Siblis Research, none of the other data sources used ...
12
votes
7answers
1k views

When hiring a quant, how can I protect my IP?

I am a one-man operation, and would like to hire a quant for around 4 weeks or work. I am worried that the person I hire might copy my data or the indicators that I have him work on. What have ...
4
votes
5answers
5k views

List of TSX stocks with their sector and industry

Is there a website that offers free download or API where I can get an up-to-date list of all securities listed on the TSX along with their sector/industry? I could scrape individual screens for each ...
0
votes
0answers
41 views

Best database source to download large number of stock prices [duplicate]

I am wondering what databases exists where I can download stock prices from 2006 to today with the following features 1) using Python API 2) using Bloomberg tickers (e.g. AAPL US Equity) 3) free ...
0
votes
3answers
325 views

News on ETF sector performance

I am interested to find historical news (if any) associated with intraday volatility burst in a particular ETFs like ishares IYF (Financials). So say that between 12:00 - 12:10pm, the ETF IYF's stock ...
1
vote
2answers
169 views

Are there any free algorithmic economic news feeds available?

I'm looking to build a news-based trading algo and I need a live news feed for economic data. Are there are free sources available? I cannot find a single one. It doesn't have to be perfect, and I'm ...
0
votes
1answer
56 views

Mean Variance optimization on hourly data with gaps

I'm building a mean variance optimizer for a portfolio of FX, commodity and bond futures. The input data is hourly returns for each underlying. Given each underlying has different market opening hours,...
1
vote
4answers
1k views

Data sources for financials of global equities

I looked through the master list of data sources but could not find any data sources for financial data of global equities. An example would be the balance sheet of, say, ...
3
votes
2answers
781 views

Market data for options

Looking for recommendations on places to get market data for options. I'm looking at NYSE and NASDAQ only. My current solution is my broker, Tradeking. I can request realtime data for 700 option ...
2
votes
3answers
130 views

Profits of US Banks

Are there any publicly available data on [aggregate] profits for domestic US banks, especially quarterly data? Most studies that I know use the "Financial Statements of Banks" from the OECD but these ...
8
votes
3answers
2k views

Automated 10-K XBRL data grab using the SEC file structure

I would like to write a program that takes as input a list of CIK/year/quarter entries. The program should iterate through the list and, for each entry, grab XBRL financial data from the SEC website ...
0
votes
0answers
36 views

Data request: Option prices for a liquid index/stock

Currently doing a course project on option pricing as a part of my undergraduate studies. However I cannot find a free dataset $D=[d_1,d_2,...,d_N]$, which would represent a time-serie of daily option ...
1
vote
2answers
81 views

Datasource of all scheduled news events for S&P 500 stocks

I am looking for a datasource which contains all news events specific to equities of the S&P 500, whose release date was scheduled in advance. That is, I am not looking for surprise news. For ...
1
vote
1answer
247 views

Are Kenneth French Research Returns log-Returns?

Does anyone know if Kenneth French's return data on his website is log returns?
2
votes
2answers
2k views

Are there any free data of DAX or DAX future in 1-second or 1-minute time resolution?

Are there any free data of DAX or DAX future in 1-second or 1-minute time resolution ? I would be happy to buy them but everywhere prices starts from 1k $ (minimum value of order), 2016 alone would be ...
0
votes
2answers
98 views

Imputation of missing returns

I'm trying to calculate a historical VaR for a portfolio of futures, however there are certain days for which some assets are missing prices. Since the portfolio consists of many spread positions, the ...
7
votes
3answers
7k views

Why the difference between SPY and ^GSPC?

Look at SPY vs ^GSPC -- the difference seems bigger than can be explained by the ETF fees. Is it only because of SPY re-invests dividends quarterly or something else? Since ...
0
votes
1answer
266 views

Bloomberg's Open Market Data Initiative

I am reading about OMDI: https://www.bloomberg.com/company/announcements/bloomberg-opens-its-data-distribution-technology/ After reading that, I am still not sure: Is it free? If so, what kind of ...
0
votes
1answer
39 views

Kenneth Frenches Data library return data to price data?

I have downloaded the industry portfolios from Kenneth Frenches data library, I am wondering if anyone knows where I can find the price data? Can I convert it even if I don't have a starting value? ...
4
votes
3answers
3k views

Source for real-time tick data (stock price, etc.) updated every second?

For educational purposes, I'm looking for a source for now's real-time tick data for stock prices, or FOREX, etc., with a 1 second precision. Is there such free data feed? If not, could such data be ...
2
votes
3answers
2k views

Data feed API that uses REST?

Is there a data feed provider that has a REST (http) API? Preferably real-time and historical, at least for US equities.
3
votes
1answer
79 views

How to obtain data for Benford's Law analysis?

First off, let me be specific as to what I mean by "Benford's Law analysis": I'm looking to test, given some data, if the set of first significant digits are independent, identically distributed ...
4
votes
1answer
131 views

Portfolio optimization with changing portfolio constituents

Say I have time series data for $N$ assets, where for the longest existing asset I have data from $t_0=0$ to $T$, but for several other assets I only have data from say $t_0+k$ to $t_0+l$ for some $0&...
-1
votes
2answers
196 views

What are some simple, free/affordable methods to obtain a spreadsheet of selected columns for a comma separated list of publicly traded stocks?

For example, if I wanted to compare a list of equities inside of a very small segment of the global economy (say, the members of the Emerging AgroSphere ETF) I'd want to know their full names, their ...
1
vote
1answer
82 views

Simulating trading strategies

I want to simulate real time trading strategies. For simplicity, let's say I only want to simulate a long-only portfolio on S&P500. I have a couple of questions: Is there a place online where ...
0
votes
1answer
631 views

How to deal with missing value in a time series stock market data?

I have collected data for the period of 2002 to 2018 for following indices Nifty (India), NASDAQ (US), ADX (UAE) and TASI (Saudi Arabia). After collection, I have arranged data in a single sheet with ...
2
votes
2answers
112 views

How do I calculate bad debt on revolving credit?

I have a revolving credit system. A customer purchases and then has 6 months to pay off the purchase. i.e. Purchase for 60 in Jan and then need to pay 10 a month in Feb, Mar, Apr, May, Jun, Jul. The ...
3
votes
1answer
171 views

Data sources for historical Eurex settlement option prices

I am looking for long history for historical settlement option prices at EUREX. This seems to be more challenge than I could imagine. Eurex themselves doesn't offer that data unfortunately (they only ...
1
vote
0answers
26 views

Identifying primary share class of U.S. firms and deleting excess observations

I have a fairly large dataset of CRSP firms with their daily closing prices from 2006 till 2017. I need to filter the data so that I have one daily observation per unique firm. I've identified the ...
14
votes
8answers
24k views

Data source for historical Share Outstanding totals for individual stocks?

Data is normally adjusted for splits/reverse splits, etc. The current shares outstanding is usually available. Is there a data repository that captures the shares outstanding for any point in the ...
4
votes
1answer
203 views

I am looking for a list of all companies worldwide with their annual revenue

I am trying to find a list of all publicly traded companies worldwide along with their annual revenue. I can get the list of stock symbols but is there a way to get their annual revenue without ...
2
votes
1answer
71 views

Downloading historical data of “Financial Account Data”

I would like to know how to download historical data from www.federalreserve.gov/apps/fof/FOFTables.aspx Please advise.
2
votes
1answer
904 views

Automatically get iShares ETF holdings

I heard that ETF's must publicly report their holdings all the time. I have seen that for example on the iShares website I can download the list of holdings as a csv file: https://www.ishares.com/us/...
0
votes
0answers
35 views

Bond Data on UK corporate

I have got data from FRED on Moody's Seasoned Aaa Corporate Bond Yield. Does anyone know where I can get such UK data on this? If not, would using exchange rates and the interest rate parity theorem ...
2
votes
2answers
675 views

Classifying stocks by industry (free)

Is there anyway to get the stock symbols of an exchange classified by industry? For example: AMD-semiconductor The best I could find was this page: https://money.cnn.com/data/sectors/tech/electronic/...
4
votes
0answers
155 views

Match different option high frequency databases

I downloaded the “E-mini S&P 500 (Dollar) Options for 1/10/11” Top-of-Book (BBO) data. If you are interested you may download the data from the following link (approx. 80MB zipped and 1GB unzipped)...