Fixed bug where removing a tag, adding it back, removing it again did not actually make it delete on the server