Before appending the address, ensure the same (or any) portal details panel is still open. The address lookup could be slow and the user may have viewed a different portal, or closed the info panel, before loading completes.