Only add keys to column errors when there actually are errors.