Sort moves the opposite way when it's black's move