Enable location services on your iPhone and set homepod intercom settings to use it when i am home or always.