prevent RemoveRef being called for a device that was never added by ohNet - ohNet can call removed when a device was not added