Sanity check to prevent ghosts from going to nullspace

Fixes #4310