Give ELB a small grace period after changing ELB listener.