The database tag has no wiki summary.
30
votes
5answers
5k views
Efficiently storing real-time intraday data in an application agnostic way
What would be the best approach to handle real-time intraday data storage?
For personal research I've always imported from flat files only into memory (historical EOD), so I don't have much ...
16
votes
2answers
2k views
Do you have historical tick data you want to donate?
Do you have historical market/pricing ticket data that you would like to donate to the Open Source Trader project (OST)??
Please: upload your files! Once we gather some data, we'll do our best to ...
13
votes
4answers
4k views
Usage of NoSQL storage in Finance
I am wondering if anyone has used NoSQL (mongodb, cassandra, etc.) to store and analyze data.
I tried searching the web but was not able to see if the financial firms had gotten in to using nosql ...
11
votes
3answers
3k views
R: How feasible is it to store — and work with — tick data in a database connected to R?
I'm looking to convert some tickdata .csv files into a database on a local disk and then use R to call the data and do my various analytics and modelling.
What are some best practices / ...
8
votes
3answers
2k views
Is there any thing out there as a substitute for KDB?
thanks a lot for your discussions on the original post.
following your suggestions, let me re-phrase a bit :
kdb is known for its efficiency, and such efficiency comes at a terrible price. However, ...
7
votes
2answers
890 views
Non-SQL methods for high-frequency accounting?
Does anyone know of any prior art for non-SQL data structures for high-frequency accounting, whether client, broker, or exchange-side? I'm thinking specifically of the problem of booking individual ...
6
votes
4answers
583 views
Best way to store hourly/daily options data for research purposes
There are quite a few discussions here about storage, but I can't find quite what I'm looking for.
I'm in need to design a database to store (mostly) option data (strikes, premiums bid / ask, etc.). ...
6
votes
3answers
277 views
Scanning a stock database for errors/flaws
I'm currently working on some matlab code that is supposed to check a stock database for any errors (missing values, wrong values, etc.). The reason for this is that after reading this post I came to ...
4
votes
0answers
98 views
single channel for multiple feeds of news? [closed]
I subscribe to various blogs and twitter feeds which I use to parse for keywords. Many times these subscriptions do not include topics which are of the primary concern.
Are there multiplex channels ...
4
votes
1answer
763 views
Why use a column database for tick/bar data?
I often hear that column-oriented databases are the best choice method for storing time series data in finance applications. Especially by people selling expensive column-oriented databases.
Yet, at ...
