Rails app to broker requests to / from the Crawler