For the MapWalker, give it the map so it can set/delete things