sakrafd/tire — comment on commit 6bb65d19e658b4f7bc5003e1e1167a49f0614acb
File:  line 0
By karmi:

Hi, I was mulling it over, talking to other users, etc. and I think I still stand by the position that we should not litter the codebase by magical `sleep` statements.

I usually tollerate those in tests, ad-hoc stuff, but `Item#bulk_store` should be really robust and transparent. I think that you may have run into some issue in ES, and it would be much more beneficial for everybody if ES would solve that for all.

The `retry` logic is more of an attempt to work around network failures, overloaded ES clusters, etc, not "timeouts" per se.

Could you try to decrease the number of docs you're pushing into ES from the default 1000? This would be a potential culprit also if your docs are big, since ES has a (configurable) limit on payload size. I mean, we're pushing thousands of docs in batches of 1000 on a regular basis, and it does not give us timeout errors...

(I thought, originally, that _bulk takes some timeout option. It does not -- the best thing would be if you'd come to the #elasticserch IRC channel and ask there, so we can involve more mindpower.)