Swap bytes if depth == 2