RemoteTaskActionClient: Retry on ChannelExceptions too