everything fixed. For each domain a seperate crawler