Improvements move css, js to assets directory and exclude for bot scanning in robots.txt