refactored consts and made a link crawler