ENH: visualization deals with empty maps

Not crashing on empty maps is useful, as they pop up every once in a
while