Remove assertion that fails for maps not in NE quadrant.

I just omitted the assertion, perhaps it could be re-factored.