crawler runs well over entire set of repos