Support (configurable) retries

Fixes #103 
Ah, ok so this must definitely be for clarity to the person reading the tests. 0*time.Second is fine in that case.