Warmers do not load field data cache for sorting on new segments
fixes #2649