For deep files, fix some subtle problems with differing per-channel formats