fix so that short_metrics: false works