Recording for Eyes, Not Echoing to Ears: Contextualized Spoken-to-Written Conversion of ASR Transcripts
Authors: Jiaqing Liu, Chong Deng, Qinglin Zhang, Shilin Zhou, Qian Chen, Hai Yu, Wen Wang


Reviewer paper summaries: The paper introduces the Contextualized Spoken-to-Written (CoS2W) task, aimed at transforming informal, error-prone ASR transcripts into formal, readable documents by leveraging context and auxiliary information. The authors present the Spoken-to-Written of ASR Transcripts Benchmark (SWAB) dataset, encompassing diverse scenarios in Chinese and English, to facilitate this task. Through extensive experiments, they evaluate various large language models (LLMs), with GPT-4 demonstrating superior performance in improving readability and formality. However, the models face challenges in maintaining faithfulness, often prioritizing fluency over accuracy. The evaluation employs traditional metrics, LLM-based assessments, and human evaluations, revealing strengths and limitations in current LLM capabilities. The study highlights the need for further research to enhance faithfulness and better utilize auxiliary information, with plans to expand the SWAB dataset and refine evaluation methods in future work.
Summary of strengths: 1. The paper addresses a significant problem in ASR transcript readability.
2. The creation of the SWAB dataset is a valuable contribution.
3. The methodology is robust, with comprehensive experiments and analyses.
Summary of weaknesses: 1. The LLM evaluator's limitations, particularly in formal scoring, need further exploration.
2. The single target annotation in the SWAB dataset may limit the assessment of model performance.
3. The paper considered the less diverse targets in the SWAB dataset.
4. The paper fails to tell the failed case.
Comments, suggestions and typos: 1. Line No. 067, 068
"These subtasks are not simply chained together but are interconnected. They are all based on a complete semantic understanding and have dependencies among them."
Should be - "These subtasks are interconnected, each relying on a complete semantic understanding that creates dependencies among them."
2. Line No. 105
Change "depend on" to "dependent on" for grammatical consistency
3. Line No. 020
"In addition, investigate" should be "In addition, we investigate"
Overall assessment scores: 2