Remove inactive players. We don't need this.