Fix a bug where click one delete would delete everything