Only remove the nullspace in a direction if the user specifies it