record which number has been swapped before