tests for caching errrors, and set maxRetries to 20 since 10 was a bit too low for multiple simultaneous clients