Yes, you can transfer your remainder interest to him: a remainder interest is as alienable or transferrable as a fee simple interest. And you can do it by quit claim deed in which you give up (without warrantying or guarantying) any and all interest you have (the remainder interest) to him.