fix minor issue in scrape command
add smart caching of requests/responses
add unique_together constraint to UrlContent
initial urls are now generated bounded to a user_agent
add webcache to .gitignore