Can you recommend a good tutorial for working with tick data for the purpose of algorithmic trading?
Is the data normally stored in a database and only bits are read into memory at a time?
Is there some useful software that's easy to get?
It's difficult to tell what is being asked here. This question is ambiguous, vague, incomplete, overly broad, or rhetorical and cannot be reasonably answered in its current form. For help clarifying this question so that it can be reopened, visit the help center.If this question can be reworded to fit the rules in the help center, please edit the question.
Yes, there is a software application that you can purchase for $39.99 which stores all your tick data in a highly compressed format while still allowing maximum throughput and lowest latency data queries that I have ever seen. The package provides APIs to all languages under the sun but because they have a special sale going on it comes with the complete back testing and trading system in one single package. And guess what, they have thrown in a CEP engine for free as well. Its too hard to pass up if you ask me. Here is the link: do-your-own-damn-work-because-what-you-are-asking-for-is-something-others-worked-years-on-and-it-sounds-you-are-just-in-for-the-low-hanging-fruits-please-ask-elsewhere.com
But seriously, dude, do a little homework on your own, google couple terms, get some basic information because you come across as being incredibly lazy, at the very least incredibly uninformed. You are asking others to give away information and to put in the time to respond to you intelligently, would be nice to see you show a little respect by doing a bit of the leg work beforehand. I am more than happy to walk you through everything but only when you ask specific questions that show you have done a bit work upfront.
Hope this makes sense!
P.S.: I guess I am just a little fed up with more and more newbie questions ending up on this site. I thought this was a forum for people working in the industry, I am not saying this is a requirement but I would appreciate it if the previously higher standard of information sharing can be again maintained. Questions like "please deliver the holy grail to my door steps" really drive me nuts...;-)