sync the offset as soon as we can after startup, make sure we don't keep a reference to players that might have logged out