Reply objects are now using JSON.  Having the message converter set on the AMQP template seems to be the key to making all of this work.