Handles the interaction between the crawler and the front end