Adds main.html content and fixes crawler.js to exit process on completion