Add a 'toggle()' method to the ManyRelatedManager, to toggle M2M relationships