Make it possible to send alerts only for a limited time rather than forever