Fix double decref in set