Correctly execute actions when they're run in the delayed phase, e.g. because of notifications.