Improve DB consistency check, use data copier also for rejected (unedited) data
Cope with non-.de domains, Google results. Tested with Google and Crawl results.
Koeln Metadata update
A plethora of changes
- Base more things on a central file type list from metautils
- Use the original version of the Python Bing API
- Adapt and improve Bing search tool
- Add ability to copy unedited data to the database
- Allow addition of 'clean' data to the DB with Google Sheets conventions
- Adapt Bochum scraper to it to test
- Output 'metadata' from Bochum scraper including things they have that we don't want
- Make duplicate cleaner more resilient
Merge branch 'master' of github.com:okfde/odm-datenerfassung