Google will determine the relevancy based on the context of a user's search, inbound links and event Wikipedia entries.
If users don't interact with the location's ad - by hovering over it and clicking through for more information - it will disappear.