Move payload serialization to Client
Upgrade to newer dependencies

* Also set prefetch to one
* Fix concurrent thread pool import