Friendly HTML crawler and url checker