added redis service to travis
expose dynamic routes
update disallows, and templatize dynamic parts
make sure snapshot output is excluded
added routesKey and robotsFile to basic config
refactored snapshots worker to source input from Redis
changed snapshots test to use debug dist
Updates for server-side snapshots, routes worker, and dynamic sitemap.xml
exclude phantomjs
added sitemap, phantomjs, node-phantom; removed grunt-html-snapshots
fixes #35, adds routes worker, dynamic robots.txt and sitemap.xml