Questions tagged [data]

Questions about handling, obtaining, generating, or analyzing all types of financial or economic data. Please use a more accurate tag if possible; for instance: tick-data, fundamentals, market-data, option-data, ticker-mapping, etc.

Filter by
Sorted by
Tagged with
2 votes
5 answers
569 views

Top 500 Companies in the World – Data

At the basis of an algorithm, I need an Excel/CSV file containing the world's top 500 companies (with respect to market cap, preferably free-float if possible) by Name, Country, Market-Cap (in USD, or ...
1 vote
1 answer
143 views

How do you identify top shareholders in SEC filings?

Schedule 13D is filed when a shareholder crosses 5% ownership and 13F is filed by fund managers to list their portfolio holdings. These are the only filings that I am currently aware of related to ...
4 votes
5 answers
22k views

Px last in Bloomberg

This is my first post to this forum. I want to calculate security returns , so therefore, I have downloaded the PX last price from Bloomberg. My question is: What is PX last in Bloomberg? Is this ...
0 votes
0 answers
19 views

Free data source for options IV and volatility data (US, UK, EUR Equities preferable)? [duplicate]

Where can I get free options implied volatility and realized volatility data? I used to use Quandl, but they were acquired by NASDAQ and now offer this data under a premium paywall. For reference, I ...
31 votes
9 answers
39k views

What is the best data structure/implementation for representing a time series?

I was wondering what is best practice for representing elements in a time series, especially with large amounts of data. The focus/context is in a back testing engine and comparing multiple series. ...
4 votes
1 answer
2k views

Efficient way to store orderbook in Python

I am using the Coinbase WebSocket API to extract real-time data about the orderbook for BTC-USD. I am using the following code to store the snapshots of bids and asks and the changes to the orderbook ...
1 vote
0 answers
82 views

How to aggregate qualitative data?

I am trying to look for methods to aggregate and find the average of qualitative data. There are 20 qualitative measures, each divided unevenly into 4 cycles labeled 1-4. I am trying to find which ...
16 votes
4 answers
14k views

Analyzing tick data

What are some of the commonly used techniques to analyze tick data? I am looking at tick data to see how the quotes/ mid-price evolves due to certain events in the market. Since tick data is ...
3 votes
2 answers
432 views

Data feed that shows individual orders

Does anyone know how I can obtain time and sales data for a stock? Lots of feeds provide the total volume but I would like to see the breakdown of what buy/sell orders made up the day's volume. I ...
0 votes
2 answers
539 views

Where to get historical price and fundamental data for global equities? [duplicate]

I'm looking for reliable research data on global equity fundamentals, but I'm not sure which vendor provides these (and preferably only these) features: Programmatic access of data. Coverage of ...
5 votes
2 answers
568 views

ML/AI in fixed income vs equity

From my perception of learning different ML/AI applications to finance I found there are lots of them in equity and not as many in fixed income. I wonder if the markets are different in some ways and ...
1 vote
0 answers
55 views

ML/DS in fixed income asset management

I am new to the topic but I would like to read papers/books/anything interesting to learn more how ML and data science is used in buy side Fixed income Asset management firms. Factor investing/signals/...
9 votes
3 answers
7k views

Red Black Trees for Limit Order Book

Why do people suggest using red black trees/balanced binary trees for the levels in a limit order book? Why are they algorithmically ideal?
0 votes
1 answer
405 views

evaluate the predictive power of a signal to predict stock price - interview question

I am a young Statistics graduate. A few days ago as an interview question, I have been asked to evaluate the predictive power of a Signal time series (supposedly output by an Artificial Intelligence ...
4 votes
1 answer
492 views

API for Commodities Stock markets

I would like to have a clear picture about lithium investments all over the World. I like this website where I can see all companies related to lithium on the Australian Market. The website also ...
2 votes
3 answers
8k views

Is there an equivalent to SEC EDGAR for non-US companies, especially Europe?

For US public companies we can go on sec.gov to find their 10-K filings etc. Are there similar services in other countries? I'd be especially interested for in Europe, France, Germany, Italy, ...
5 votes
4 answers
1k views

Loading HF stock data into excel

Are there any free, open source VBA addins or R packages that can be linked using the yahoo finance/Google finance/other data sources api to continuously download intraday data into excel or R? https:...
-1 votes
1 answer
82 views

Can NumPy calculate the % change the way it is shown in multiple instrument charts?

I have closing prices for multiple equities in NumPy arrays (or a pandas timeseries DataFrame). I like to calculate the % change numbers for the closing prices in the DataFrame the way it is shown in ...
0 votes
1 answer
609 views

Which spread to use to analyse CDS data from Markit

So I am currently doing some analysis on CDS Data and I am using Markit to extract this data. However, I am a bit confused regarding the quotation standards here. I want to investigate the ...
30 votes
11 answers
19k views

Training set of tick-by-tick data?

I'm looking to find a free source of tick by tick data (<1sec) for training purposes. It doesn't need to be longer than a day, and I don't care what instrument, or exchange, or time it is. I just ...
0 votes
2 answers
236 views

Where can I get fundamental data on US public stocks in original form?

I'm looking for fundamental data on US public companies. If anyone could recommend paid or free sources of the fundamentals in original, non-standardized form that would be great. I tried scraping the ...
1 vote
1 answer
756 views

Downloading Historical Data from Finam.ru

I am looking for free historical intraday data (e.g., 30 mins, 1 hour) and I have came up to this website finam.ru, which is in Russian but it can be translated. The link to download the data is here. ...
1 vote
2 answers
538 views

Storing options EOD time series in Flat Files

I have purchased data for EOD settlements of options prices for USA futures for personal use. I will not need multiple user access or real time access. I am not an expert programmer but use C# and R ...
1 vote
1 answer
71 views

should I persist the daily/weekly bar data

Suppose a small quant group (4 guys) and the tick data is in hand, shall they persist the historical daily/weekly or even smaller scale like hourly/minutes bars data, or just do the on-demand ...
0 votes
0 answers
66 views

Should I always round the data before even trying defining and backtesting my trading strategy?

Newbie here, it happens that I have 8 months of OHLC price data set at 1 hour timeframe from a particular cryptocurrency (ticket) called ALICE, here's a little ...
0 votes
0 answers
42 views

SONIA Reference Data Calculation / OIS Data

I am reading material reference rates calculation for SONIA by refinitiv. It says the data is calculated based on OIS Rates between 10:50AM and 11:00 AM. https://www.refinitiv.com/content/dam/...
0 votes
0 answers
64 views

Italy Zero Coupon Yields

I am looking for historical data for Treasury bills and bond yields for Italy on a monthly or daily basis. Where can I get this data?
0 votes
4 answers
522 views

Imputation of missing returns

I'm trying to calculate a historical VaR for a portfolio of futures, however there are certain days for which some assets are missing prices. Since the portfolio consists of many spread positions, the ...
2 votes
0 answers
130 views

Back testing fixed income for bond portfolio management

When doing back test trying to replicate a paper, how do you handle bonds that are maturing in an index? Say I was trying to create a strategy, how do I account for bonds that mature in terms of ...
0 votes
1 answer
192 views

Cap/Floor on a SpreadOption grid

I have a spread option data from a broker. The rows are the following : STK ATM -0.5 -0.25 ... and the values are forward price ( the strikes used are absolute strike and the value of the raw STK is ...
5 votes
2 answers
2k views

Retrieval of MSCI factor index performance data from the web

I hope this question is on-topic. What is a convenient way to get MSCI index performance data from the web? I would be interested in daily performance data of the factor indices momentum, minvol, ...
4 votes
6 answers
9k views

Place to get free live Forex quotes via API?

Are any free Forex data APIs available? There are a ton of historical data repositories that are freely available but what about a live, streaming data API? 1 minute updates or tick data would be ...
0 votes
0 answers
125 views

How can I calculate the annual Standard Deviation for Sharpe Ratio of Daily Portfolio Returns?

I'm somewhat confused with regards to calculating the annual standard deviation and Sharpe ratio for my portfolio of daily returns. I have daily data ranging from 1960-2020 and use Excel to make some ...
10 votes
3 answers
4k views

Algorithm to detect the aggressor side of a trade

Most of the exchanges provide aggressor side property of trades (e.g. Tag=5797 AggressorSide on CME) in their raw data. But many data providers do not provide this information via their datafeed API's....
1 vote
2 answers
359 views

Where do big data companies get data?

First time posting at Quantitative Finance, hope the question is well suited in this stack section. I was wondering, where does big companies like Bloomberg or Reuters get their data? Since now, in my ...
4 votes
3 answers
3k views

List of ticker-symbols of European countries

To download the European countries' equity (stocks) data from CRSP database, I need individual stocks ticker symbols. Can anyone help me regarding how can I get the list of ticker-symbols of European ...
0 votes
3 answers
3k views

Databases for storing and querying high frequency tick-level data?

My firm is looking for an out-of-the-box database system to store and query high-frequency tick data. What are the best options? It seems that kdb+ is the market leader in this field.
4 votes
4 answers
17k views

where can i get data for foreign exchange order flow

I need data for my thesis research on liquidity of foriegn exchange for order flow (aggregated daily) per currency traded for a period over the last 10-15 years. help!!
1 vote
2 answers
625 views

What kind of data cleansing/scrubbing are hedge funds doing?

It's a well-known fact that several hedge funds have a handful of PhDs just doing data cleansing. All day. Every day. What kind of data cleansing are they actually doing? Is it really that difficult? ...
0 votes
1 answer
208 views

Swap data- couldn't find any

I'm a student and i amm looking for a swaps rates historical data for long tenors in purpose to estimate yield curve (for example in GBP). My question is where could I find it?
0 votes
0 answers
797 views

Fama-French factors creation using Bloomberg data

The standard FF factors as published by K. French (https://mba.tuck.dartmouth.edu/pages/faculty/ken.french/data_library.html) are created using CRSP data. If one downloads the (US) factors, the first ...
1 vote
0 answers
2k views

Historical data for total market capitalization

I'm working on a data analytics certificate and need historical data on the total market capitalization for the US for a course project. Can anyone suggest a source?
1 vote
2 answers
1k views

Difference in weekly and monthly data

I am confused about the following: I checked daily and weekly prices for Exxon (and also GE). But the values for Open, Low, High, Close, Vol., Adj. Close for both data streams seem to differ from each ...
12 votes
1 answer
2k views

What's the most efficient way to store options and time series data for backtesting?

I would like to know what database would you guys use for storing around 500GB-1TB of options and time series tick data. The idea is to use it for backtesting so it would have to be as efficient as ...
2 votes
1 answer
1k views

Bloomberg API / Excel Add In - Delisted Stocks

So I am using the Bloomberg Excel add in but can also use the API. My dilemma is I have a list of tickers containing SP500 historical constituents and I have retrieved 600 of them from an alternative ...
0 votes
3 answers
2k views

How to get know when CUSIP is changed

CUSIP code is not a constant, it could be changed. Does anybody know how to detect a CUSIP change? Is there any report with this info? Where can i find it? Thank you.
0 votes
0 answers
257 views

Historical ISM report on business?

Is there any place to download historical ISM ROB (report on business)? The website only shows current and previous month. ISM ROB
0 votes
1 answer
124 views

How could I identify peers of companies (stocks) at scale?

Context: I'm making a small script to screen through thousands of companies at scale. A feature that I want to include would be relative metrics, e.g. is this company growing faster than its peers, ...
0 votes
1 answer
128 views

Non-fixed stationary "conversion"

Dear users of StackExchange, I was wondering why the log returns of a fixed period of time is such a common use in "transforming" a time series into a more stationary one? I thought that ...
3 votes
2 answers
39k views

Price at Specific Time from Bloomberg

I have a file where I easily export real-time prices to excel using the Bloomberg Add-In, using the formula BDP. Is there a way to get these prices of a specific time? For example, =BDP("EURGBP ...

1
2
3 4 5
10