make sure to remove clients when they disconnect so that remote process don't fall over trying to send io messages to them

Signed-off-by: Chris Granger <ibdknox@gmail.com>