Added domain filter to spider.js
Add a check to only parse HTML files
Made the mime function more generic