Listen for connection if not using proxy

The commit message says it all :)