Hot answers tagged

5

You could try Arctic. Other open source column-oriented databases that you may not have considered include LucidDB and C-Store.


3

Let me start with a general point: Why do you want to use these datapoints if it is so hard to understand how they are constructed? First of all 4) I am not familiar with testing momentum strategies but you should be aware that the datapoints given are not normal assets you can invest in at the end of the day because at the end of each time period they are ...


3

OpenTSDB is good for large-scale time series storage. metrilyx/opentsdb-pandas and wiktorski/opentsdb_pandas seems to provide the interface with pandas. OpenTSDB and HBase rough performance test | MoreDevs provides a benchmark, may not exactly match your requirements but you can try.


2

Disclosure: I work for the company developing ATSD. Axibase Time-Series Database is not open-source but its community edition is free. Time precision is milliseconds. Value is float, double or long. It supports OLCH period aggregators (first, min, last, max) as well as min_value_time and max_value_time aggregators: min_value_time Time when the minimum ...


2

There is a times series DBMS (InfiniFlux) that can be easily used with Python. The database is not open source but it does provide a free version for evaluation, too. So you can try whether the DBMS is suitable for your project. You are asking 2M rows should be processed in less than 30 seconds, InfiniFlux can store and retrieve more than 500,000 data ...


2

Cassandra is the obvious choice. With MongoDB or any RDBMS, you will hold all ticks in a table (collection in Mongo-speak) and index by ticker. This means that when you want to retrieve data for a ticker, the data will not be contiguously stored, and you will have a massive usage of index and random reads. Even with SSDs this is slow. For 500k ticks into ...


1

For what concerns Forex data which is, however financial data after all, I often use http://www.histdata.com/. Their data is delivered in .CSV format. For timeframes, I quote the website: We can only deliver you time ordered Tick and M1 (1 minute) data. The data that we have available is organized by forex-pair/year/month. They also provide data for ...


1

I've run into this issue as well. I can't find any official documentation, but the issue arises because the SEC makes up CUSIPs for all of the options on the list. It does this by taking the first 6 digits of the underlying equity (which makes sense, as this represents the issuer, which should be the same for the stock and the option), and then for the 7th ...



Only top voted, non community-wiki answers of a minimum length are eligible