refactoring, move crawler process code to concern