Don't clear layers on moving.

It was pretty intolerable to clear the map between moves.

E.g. if you clicked on a marker, the map centers itself - which thus
causes the map to clear and refresh.