Fix race condition where we unsafely remove player entity from async thread