You may not always prevent ovarian cysts, but taking contraceptive pills can reduce the risk of cyst formation to some extent.