Deselection works better
Only gems next to each other can be swapped.