Remove the key entirely instead of assigning to null