Handle the case when IsInvalid will be called for the first time after call to ~LibraryLifetimeObject