ENH raise error if different label type