He may have the numbers of a lot of women, but Dowd alone has his.
He has many women's numbers, but only Dowd has his number.