Have a finite amount of retries then give up