Fix bug when removing user labels on sign out