Unroll find_cm and avoid preallocating dictionaries in chaperones