Only set the ansible_controller fact for non-localhost connections
Limit the hosts to localhost for the sudo play