Remove reference of popped objects so they can be garbage collected