Unmanage mirror entity if remote is removed.