Initial Code to reduce parallel.Client caching

See #1131 for the discussion

Up to now it only adds a purge_client_cache() method and fixes two minor bugs.

This is probably not merge ready!