Fix device removal in DeviceManager::driver_scan()