RefCount test fix

We introduced an assert to check that no refcount is detached when
it only has one reference. That means that we cannot longer test
for this since the assert will be triggered.
Removing the assert.