I am finance grad student, and working to create a financial statement database. My objective is to download an income statement, balance sheet, and statement of cash flows for every publicly traded company that has filed with the SEC in the past 3-years.
Could this be done with a FTP connection to the SEC's directory, and would I be able to find what I am looking for there in the XBRL's? http://www.sec.gov/edgar/searchedgar/ftpusers.htm
Any insight, or alternative suggestions are welcomed. Thank you in advance!
P.S. I have considered using a bot and crawling a site that offers financial summaries, but am uncertain how viable this would be if they block my IP. Has anybody else tried this? Are some places more apt to block an IP than others?