ChannelConversion: Delay the packet if we don't have the public key yet.

I'm guessing the isinstance isn't required anymore.