Dismiss any lingering alerts after lettuce scenarios