Don't worry, you can just manually select the correct speaker based on the transcribed text and regenerate the video.