did some research into elasticsearch and started to add it to the project, then had reset my brain and started to re-focus on the spider portion of this project.  I have added a basic spider that I found along with a slightly better version I created, but still lacks a great deal.  This spider will only cater to perhaps 2 to 3 websites at first (2 search engines and one page on a simple site.  More to come...