Don't add prefixes to valid channel modes, but their modes.