Updated for new Hamburg portal
Make crawler more robust/sustainable:
- Detect repeating URL paths/arguments
- Allow blacklist items per domain (taken from DB) or globally
Merge branch 'master' of https://github.com/okfde/odm-datenerfassung