Cleanup loaded features and constants after dependency tests.

cc @senny
we should probably keep this one but move it into an `ensure` block.