Fixed negative netty sleep values.

For some context, it seems that retries.get() occasionally returns negative values.