If your mortgage has an early repayment charge, this charge will be applied to the difference between the two mortgage amounts when downsizing.