Skip to main content

Questions tagged [database]

A structured collection of data, with meta-data describing is content and meaning. Also for database management systems (DBMS) which are software products for managing and manipulating that data.

Filter by
Sorted by
Tagged with
82 votes
9 answers

Efficiently storing real-time intraday data in an application agnostic way

What would be the best approach to handle real-time intraday data storage? For personal research I've always imported from flat files only into memory (historical EOD), so I don't have much ...
Karol J. Piczak's user avatar
92 votes
10 answers

Building Financial Data Time Series Database from scratch

My company is starting a new initiative aimed at building a financial database from scratch. We would be using it in these ways: Time series analysis of: a company's financial data (ex: IBM's total ...
mountainclimber11's user avatar
64 votes
20 answers

Is there any thing out there as a substitute for KDB?

thanks a lot for your discussions on the original post. following your suggestions, let me re-phrase a bit : kdb is known for its efficiency, and such efficiency comes at a terrible price. However, ...
Peter Peter's user avatar
19 votes
2 answers

Do you have historical tick data you want to donate?

Do you have historical market/pricing ticket data that you would like to donate to the Open Source Trader project (OST)?? Please: upload your files! Once we gather some data, we'll do our best to ...
jordan.baucke's user avatar
10 votes
3 answers

Scanning a stock database for errors/flaws

I'm currently working on some matlab code that is supposed to check a stock database for any errors (missing values, wrong values, etc.). The reason for this is that after reading this post I came to ...
user avatar
37 votes
7 answers

Usage of NoSQL storage in Finance

I am wondering if anyone has used NoSQL (mongodb, cassandra, etc.) to store and analyze data. I tried searching the web but was not able to see if the financial firms had gotten in to using nosql ...
user697697's user avatar
12 votes
1 answer

What's the most efficient way to store options and time series data for backtesting?

I would like to know what database would you guys use for storing around 500GB-1TB of options and time series tick data. The idea is to use it for backtesting so it would have to be as efficient as ...
edd's user avatar
  • 223
4 votes
1 answer

how to treat NA values in Compustat and CRSP

In some years, some accounting values of some companies are missing in Compustat and CRSP. How do I treat those missing values ? Should I replace those with zeros or just simply delete years in which ...
BlueFx's user avatar
  • 117