Lots of changes to the text analysis. I changed the data structure to a single dictionary (url_stats), but this was then too big for the javascript in the template to handle. So the view has been changed to output each urls's data as a JSON file. The template hasn't been updated yet, so it still looks for the url_stats object. The next step is to move all the code out of the view into the pipeline, then change the template to import the JSON files. The database is now in gitignore - it was getting too big.

	modified:   ../.gitignore
	new file:   BStest.py
	deleted:    BeautifulSoup test.py
	modified:   SiteCrawler/pipelines.py
	modified:   SiteCrawler/pipelines.pyc
	modified:   SiteCrawler/screenshooter.pyc
	modified:   SiteCrawler/settings.py
	modified:   SiteCrawler/settings.pyc
	modified:   SiteCrawler/spiders/myclasses.py
	modified:   SiteCrawler/spiders/myclasses.pyc
	modified:   SiteCrawler/spiders/myfuncs.py
	modified:   SiteCrawler/spiders/myfuncs.pyc
	modified:   SiteCrawler/spiders/sitecrawler_spider.py
	modified:   SiteCrawler/spiders/sitecrawler_spider.pyc
	new file:   bstestfile.txt
	new file:   bstestfile2.txt
	new file:   bstestfile3.txt
	modified:   initiator/templates/text.html
	new file:   newhtml.txt
	new file:   sentence errors.txt
	new file:   sitecrawlerdb
	new file:   sitecrawlerdb - Copy (2)
	new file:   sitecrawlerdb - Copy (3)
	new file:   sitecrawlerdb - Copy (4)
	deleted:    sitecrawlerdb.db
	new file:   test.py
	new file:   test2.py
	modified:   testlog.log
	modified:   views.py
	modified:   views.pyc
	new file:   views_old.py