When the flower is past it's prime, deadhead it. It takes me just a couple of minutes a day. I tend to walk around my yard in the morning and if I see some flowers that need deadheading, off with their heads!