Add retries to fetch_qa_suite()

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>