improved crawler that actually looks for keywords