Update packet manager to use ExtendableMessageOrBuilder