You have chosen the one point that to my mind tells against him."
You have made a point that is against him.