started to implement async version of crawler