Create retry tests (WIP)

This branch is blocked on mimic changes for injecting specific behavior or number of errors.
Also, could we verify that the server exists for real by making a call to nova. Maybe using `check_for_expected_number_of_building_servers` or `get_servers_containing_given_name_on_tenant`