Fix case where the registrar is not the table owner but a swap message is sent.

h/t @buddhisthead 
cc @rzezeski