Adding a flag that can limit the max number of retries for tests