Before revision:  Thus, during fine-tuning, the speech module alone can produce representations carrying both acoustic information and contextual semantic knowledge  .
After revision:  Thus, during fine-tuning, the speech module alone can produce representations carrying both acoustic information and contextual semantic knowledge of an input acoustic signal .