Cleanup dupe configs in instance root