Add toggle logic for when trying to remove rating