Remove the handle at the right time.