Decoupled crawler and parser a bit.
Please Rubocop a bit.