Actually add stuff to the map