Create retry tests (WIP)

This branch is blocked on mimic changes for injecting specific behavior or number of errors.
same here. Could we verify that the server exists for real by making a call to nova.