Add/remove remove-icon on click in VRF selector

Fixes #380.