Doctors used to prescribe the combined oral contraceptive pill for ovarian cysts, hoping this would make the cysts shrink. But we now know that this doesn’t work. However, if you keep having complications from an ovarian cyst, your doctor may offer you oral contraceptives to prevent ovulation. This may help reduce your risk of complications in future.