Episode #125 of the Stack Overflow podcast is here. We talk Tilde Club and mechanical keyboards. Listen now

Questions tagged [data]

Questions about handling, obtaining, generating, or analyzing all types of financial or economic data.

Filter by
Sorted by
Tagged with
3
votes
1answer
454 views

how to treat NA values in Compustat and CRSP

In some years, some accounting values of some companies are missing in Compustat and CRSP. How do I treat those missing values ? Should I replace those with zeros or just simply delete years in which ...
0
votes
1answer
154 views

(Self studying) Finding data on Bloomberg

I apologize for asking this very simple question, but I was reading through this chart for the first time, and I would like to know where on Bloomberg can I find data like these, since I have to price ...
1
vote
0answers
31 views

amount of data - option pricer calibration

A practical question. When you calibrate an option pricer (whatever the model is), do you use data from several days or just one day (last trading day)? I noted some papers use data from one single ...
2
votes
2answers
998 views

Mapping I/B/E/S to Compustat via 6-digit CUSIP

I am trying to link Thomson Reuter's I/B/E/S dataset with Compustat. Both I obtained via WRDS. The only halfway useful info I could find was on a two year old forum post, which suggests to go through ...
1
vote
0answers
55 views

How to handle database updates for splits/dividends?

I'm finding it an difficult task to maintain a database of stock prices. My main problem is how to efficiently handle splits and dividends. Is it better to handle this in a database with adjusted ...
0
votes
3answers
496 views

Appropriate way to normalize Bollinger Bands?

I am playing around with using neural nets to make predictions on market trends. I am currently feeding in a portfolio of historical data of many stocks, and am now implementing several technical ...
4
votes
5answers
3k views

Where to find historical stock news and other events?

So, I am working on a strategy that has pin-pointed some very interesting events in the form of extremely low volatility. The phenomena spans the past few years and a wide variety of symbols. Now, to ...
0
votes
1answer
354 views

Data: to clean or not to clean

From risk management point of view using cleaned data (excluding or modifying extreme/outlier observations) would give less conservative measure as compared to real-world raw data. So they are more ...
4
votes
1answer
3k views

Where can I find open swaption implied volatility data?

Anyone have a good place to find interest rate swaption implied volatility data? Does Bloomberg's python API allow access?
1
vote
1answer
111 views

Dividend Yield Goyal and Welch (2008)

Following the Goyal and Welch (2008) stock return predictability data, does anyone know how they calculate the dividend yield from the dataset that they provide on Amit Goyals website http://www.hec....
0
votes
1answer
149 views

Where can I find historical data for Europe listed ETFs?

I'm currently working on building a portfolio optimization tool for European ETFs such as: (SYMBOL/ISIN/description) IQQF / IE00B0M63730 / iShares MSCI AC Far East ex-Japan UCITS ETF EXW1 / ...
13
votes
4answers
13k views

How to get list of all CUSIPS/ISIN?

I want a list of all CUSIPs/ISINs. It would be nice if they were also categorized (e.g. Bonds/Funds etc). Where can I get such a data?
0
votes
1answer
356 views

Download bond yields R

I need to download bonds yields using R. I tried, as usual, I did for stocks: spc <- new.env() setDefaults(getSymbols,src="FRED") getSymbols("^AT0000386198", env = spc, from = "2010-01-01", to =...
1
vote
0answers
41 views

Transform 24hr cumulative volume to sampled periods

I have a Python Dataframe with cryptocurrency data that has three columns: time, 24hr volume and price. The time is the time at which the data was received from the exchange, price is the last price ...
2
votes
1answer
193 views

How to adjust Geometric Brownian Motion to be monotone?

I want to use stochastic process to model subscriber's mobile data consumption as time going in a month. So I think about Geometric Brownian Motion. However, people's cumulative data consumption ...
2
votes
1answer
468 views

Where can I find ETF fund flow data?

I know mutual fund data can easily be found on CRSP or Thomson Reuters, but where can I find solid ETF data, specifically their flows?
1
vote
0answers
138 views

Any databases with CEO letters and shareholder letters?

I am researching disclosures on CEO letters and Shareholder letters present in annual reports of listed companies in the London Stock Exchange. Can someone recommend a database where the annual ...
1
vote
3answers
115 views

Given only Bid Ask and quantity Data, how do I determine whether the security price has gone up or down?

Given Bid Ask Hang Seng Index Future Data, how can I determine whether the current index future price has gone up or down relative to the last price? ...
2
votes
0answers
90 views

FTSE 350 sector index historical data

Does anyone know where I can find (at least 10 years worth of) end of day historical (op, hi, lo, cl) data for the FTSE 350 Sector Indices?. I need the data for ...
1
vote
1answer
162 views

Interest rate models

I'm studying by myself how to model interest rates. Is there any database in which I can find accurate data for indices like Libor, Euribor, Eonia etc?
1
vote
0answers
184 views

List of US Industry sector ETFs that map to ICB classification

I am in the prcess of carrying out intra-and intra sector analysis of US stocks, and am proxing sectors with sector ETFs. I therefore, need to catalog the list of US sector ETFs - but have been unable ...
51
votes
6answers
84k views

Where to download list of all common stocks traded on NYSE, NASDAQ and AMEX?

I have a very basic data question: how to get a list of all common stocks traded on NYSE, NASDAQ and AMEX? I would need to be able to get the approximate list of common stocks as is available in ...
2
votes
2answers
840 views

CRSP common stock only

How can I download exchange data for only common stocks (excl mutual funds, ETF, etc) on the NYSE, NASDAQ, and AMEX? I can't find a list of tickers or anything. Does anyone know a method? And does ...
2
votes
3answers
12k views

where can i get data for foreign exchange order flow

I need data for my thesis research on liquidity of foriegn exchange for order flow (aggregated daily) per currency traded for a period over the last 10-15 years. help!!
3
votes
4answers
6k views

Does Yahoo/Google no longer support web-scraping of FOREX data?

I use Python 3.6 to develop quantitative FOREX trading strategies. I used to use Yahoo or Google in conjunction with pandas.datareader in order to collect forex ...
0
votes
1answer
22 views

Possible correlations to institutional allocations versus market capitalization

I seem to remember someone telling me a while back that a good indicator of future equity performance was how "institutionally under-owned" a given equity is versus its weight in a given broad market ...
-1
votes
1answer
472 views

How to use exponential smoothing for trading?

I was wondering if there's a rule of thumb regarding the value of alpha used when performing exponential smoothing. I plan to use this technique to preprocess my data before feeding them into my ...
5
votes
3answers
940 views

Loading HF stock data into excel

Are there any free, open source VBA addins or R packages that can be linked using the yahoo finance/Google finance/other data sources api to continuously download intraday data into excel or R? https:...
-1
votes
1answer
470 views

Where to get historical IV rank & IV percentile data?

I thought my broker (Interactive Brokers) was offering this but looks like what they actually supply is IV / with historical realized volatility. I also checked Quandl but as this is not data for ...
1
vote
1answer
86 views

Short selling volume reports

I'm researching short selling volume data reports from NYSE, NASDAQ and BATS (Sources: FINRA + BATS website). And my question is: Why are those numbers so high? Is it really just a speculative short ...
1
vote
1answer
67 views

What information is significant in a company's 10Q?

From a quantitative point of view which information is significant, what can be ignored?
1
vote
0answers
104 views

Winsorization and Standardization in data manipulation

Suppose there are two time series of data, ask price and bid price in options. They are used to calculate bid-ask spread($\frac{P_A-P_B}{P_{Mid}}$). I attempt to use winsorization and ...
5
votes
1answer
961 views

Open source equity/bond index data

I have been using the tseries package of R (get.hist.quote) to get historical quotes for various indices from yahoo finance. I am interested in DAX, VDAX, EB.REXX ...
2
votes
2answers
597 views

Database of ETF and underlying index from Thomson Reuters or Bloomberg

I want to generate a table of ETFs listed in the US and declared benchmarks. The idea is that I want to have the possibility to use the benchmark as a proxy of the ETF to run longer backtests when ...
1
vote
1answer
2k views

Problems retrieving historical data through IbPy

I am having problems retrieving 14 days historical data from IB. I recently made the switch from MATLAB to Python so I have a lot of catching up to do. Where do I go wrong? All help is appreciated. ...
7
votes
5answers
6k views

Monthly data for popular indices (constituents).

Trying to be concise: I am interested in the most popular indices (SP500, FTSE100, DAX30, CAC40, SMI30, etc). For each index I want to know its constituents in a monthly basis. For each constituent (...
3
votes
4answers
773 views

How to get Stock Fundamental time series data?

I need key Stock Fundamentals like in http://finance.yahoo.com/q/ks?s=KO+Key+Statistics But that page shows only the last quarter data, I need to analyze how that data has changed over past years. ...
1
vote
0answers
297 views

What symbols to use on Google Finance and Yahoo finance OMX30

I want to download historical data using pandas_datareader for OMX30, however I cant find any symbol which can be found using pandas_datareader. For example: STO:...
0
votes
1answer
14k views

Price at Specific Time from Bloomberg

I have a file where I easily export real-time prices to excel using the Bloomberg Add-In, using the formula BDP. Is there a way to get these prices of a specific time? For example, =BDP("EURGBP ...
8
votes
3answers
6k views

Where can someone get free (or very cheap) high frequency tick forex data?

I am currently working on a large data set (approx 80 million data points over 10 years). I would like another set of data that has one currency in common. Eg, I have EUR/USD and would like USD/CNY or ...
-4
votes
1answer
180 views

API to perform queries on stocks and financial derivatives [closed]

Is there a native and free API and DB to request information such as: All the companies which their P/E ratio is greater than 50 The closing prices of stock <...
4
votes
4answers
14k views

How can one query the Google Finance API for Dow Jones and S&P 500 values?

The queries for Dow Jones and S&P 500 will result in error: http://www.google.com/finance/historical?q=.INX&startdate=May+11%2c+2015&enddate=May+17%2c+2016&output=csv http://www....
31
votes
9answers
23k views

How should I store tick data?

How should I store tick data? For example, if I have an IB trading account, how should I download and store the tick data directly to my computer? Which software should I use?
9
votes
4answers
2k views

Free/cheap source of structured historical quarterly filings?

What is a good place to acquire cheap/free historical quarterly filings data for US Companies? Specifically, I'm interested in the consolidated financial statements. The data should be well-structured ...
1
vote
0answers
45 views

Has anyone found good data sources to model / backtest crypto-currency trading strategies? [duplicate]

I want to write trading strategies for crypto-assets. I am looking to find data sources I can play with to backtest. Has anyone found easy to use data or do I have to index / crawl data sources?
3
votes
1answer
288 views

Relation between price changes and trading volume (market impact)

It is quite a well-know phenomenon that trading volume has an impact on a stock price: the more you buy the higher is a price because of demand increment. I'm wondering about models that can describe ...
1
vote
1answer
423 views

Difference between CRSP equal weighted and composite index

I am a bit confused about the overall CRSP total market return index and the equal weighted index. I know that the value weighted index places a weight on each firm by their respective market values ...
1
vote
5answers
2k views

API-based equity screeners?

I know there are APIs from different brokers that allows you to trade and also obtain information about specific companies, but I wonder if there are equity/asset screeners that are API-based and can ...
2
votes
2answers
695 views

Reliable stockmarket holiday, open and close time dataset/api?

Is there a reliable machine readable source of stock market holiday calendars? I found this source: https://eresearch.fidelity.com/eresearch/markets_sectors/global/holidayCalendar.jhtml I could ...
1
vote
2answers
649 views

Bloomberg Alternative for Quant Fund

Is there an alternative to Bloomberg for someone who only needs historical data (stocks, futures, indices) as well as what Bloomberg calls 'reference data' - i.e. what is the multiplier of ESU4, what ...