Add an inversion of possible cells a number can be in.