inert_drv: deselect fd's on stop

Fix segfault when using file descriptors stolen from inet by removing
the fd's from driver_select when the driver's stop callback fires.