Refine to make no Thread will wait block info that we marked removed