Only start tracking the position when needed