Turn on retry for the application benchmarks.