You can do that as long as you have extra cash to repay your co-owner share of the outstanding mortgage and CPF used.  This is why most will need to sell their share of the property at valuation so that they can have the extra funds from a mortgage loan to repay their co-owner outstanding mortgage and CPF used.  Your stamp fees will still be payable at the current market valuation.