Add license
Add proper User-Agent and do robots.txt checking