Avoid the multiple deserialization for input entries in JoinOperator