Make sure src and dest are both on the board before indexing them