small refactorings to add controller code for streaming crawler responses