The progesterone would compete with the excess androgens thereby reducing androgen levels. I think that is what she meant.
Excessive amounts administered over the long-term is usually irreversible.
I know, because my healthy lifestyle didn't resolve my chronic cystic acne. A drug called Accutane did. It tends to run in families. It can also be a symptom of an underlying endocrine disorder, such as Polycystic Ovaries.