Always accept direct connections

Signed-off-by: Stéphane Graber <stgraber@ubuntu.com>