adding Derek's crawler and utils changes