Revert "Remove handle when dispose is called for the first time"

This reverts commit 05d23bb40c3e4d409e748a77bddc556ce0281dff.