Insert the object into the slot manually to do a weak ref.