more crawler updates