If you tap the arrow icon in the top left corner of the map (on Android, tap the visor icon), the map will centre on your current position. And from then on it will follow your position.
As soon as you move the map to display a different area, for example, it will stop following your position.