Remove lock when unlocking, not when object destroyed