earthreader/libearth — pull request #50 by Kjwon15 (2014-05-27 11:22:24+00:00)
Title: Crawler using custom user-agent. Fixes earthreader/web/#44

Some sites deny User-Agent like `Python-urllib/2.7`. So we need to using custom User-Agent.