more crawler changes