Prevent the counter cache from being decremented twice

when destroying a record on a has_many :through association