Correctly handle Ns as well as double parity checks