Fix clearing selected tag when removed from last item in view

I somehow broke this in d2f028d797c5c0ae3d77d54a5bbabaa5cd4a961b, though
I'm not sure how.