Fix label hidden before the view is hidden, not after