Try a lazy unmount if device is in use