Unreference the udev device