Initial commit
adding scripts and files from ScraperWiki
adding revised trust list script
Add details of what we are going to do
some test data
Merge branch 'master' of https://github.com/rjmunro/accessibility-scraper
Initial commit of basic starting script
More README
Updated keys of test data to remove NHS dependance
adding Boostrap and index.html files
Added index.html file
Rename and fix keys of file with all sites listed
adding checkfile for robots.txt & humans.txt
Change trust to site
Update README
Check if site supports or redirects to ssl
adding sitemap check and link tag collection
Add shebang line
Include doctype info
using rootnode to pass to checkLinkTags