remove vestigal bits of conv layer