Saved desired state when adaptor is not present

This prevents a bug that appears when devices are removed/inserted.