FinalizeJoinOperation should not be blocking

Fixes #4147