Support (configurable) retries

Fixes #103 
Yea, that's my Ruby showing :smile: