Tear down the helper at the last possible moment, so that the dragstop callbacks can still access it.