Retain iface list ref only for UDP reader (1 ref per handler).

Change-Id: I6dd8a10278383e8c97e399562fec3562cbb848d8
Always stop and join I/O handlers before deinitializing.

Change-Id: If7b7a325ed20432d8fc3da73e931e0fa44a37add