Retry multiple times before giving up on fetching splits

Just what the title states, retry multiple times before giving up, hardcoded to 5 times.