Since you're returning a new physical resource ID, CloudFormation will issue a delete for the old one.  So you should not be releasing the old address above.