add some more helper functions
Update dev-requirements.txt and clean up consumer for new scrapi