controller: Properly handle errors on using multiple router clients.

Signed-off-by: Blaž Hrastnik <blaz.hrast@gmail.com>