[major=AI | course_id=SLP301 | syllabus_id=13945 | semester=7 | combo=AI17_COM2.1 | title=Speech Processing]
Course ID: SLP301
Title EN: Speech Processing
Title VI: Xử lý tiếng nói
Credits: 3.0
Prerequisites: CSD203, AIL303m
Description: This speech processing course comprehensively explains how humans and machines generate, transmit, and process speech signals. The course covers speech production, phonetics, acoustic analysis, speech perception, speech recognition, natural language processing, and speech synthesis. Students will learn about the principles and algorithms behind various speech-processing techniques, including signal processing, machine learning, and deep learning. The course also covers speech processing applications in speech recognition, speech recognition, speech synthesis, and speech enhancement. Upon completing the course, students will have a solid foundation in speech processing and be equipped with the necessary skills to tackle real-world speech-processing problems.
Student tasks: '- Students must attend at least 80% of contact slots in order to be accepted to the final examination.
- Student is responsible to do all exercises, assignments and labs given by instructor in class or at home and submit on time
- Use laptop in class only for learning purpose
- Promptly access to the FU FLM at http://flm.fpt.edu.vn for up-to-date course information
Tools: No
Course type: traditional
Decision: 1318/QĐ-ĐHFPT dated 11/27/2025
Approved date: 2025-11-27
CLO1: Gain a comprehensive understanding of fundamental principles in processing speech signals, covering digital signal processing (DSP) methods, feature extraction, and speech signal analysis
[1] category=Assignment 1; type=on-going; weight=15.0; duration=45'; question_type=CLO1; grading_guide=- cover content CLO1; completion_criteria=; clos=>0
[2] category=Assignment 2; type=on-going; weight=15.0; duration=45'; question_type=CLO2,CLO3; grading_guide=- cover content CLO2,CLO3; completion_criteria=; clos=>0
[3] category=Progress test 1; type=on-going; weight=15.0; duration=20'-30'; question_type=CLO1,CLO2; grading_guide=- cover content CLO1,CLO2; completion_criteria=; clos=>0
[4] category=Progress test 2; type=on-going; weight=15.0; duration=20'-30'; question_type=CLO3,CLO4,CLO5; grading_guide=- cover content CLO3,CLO4,CLO5; completion_criteria=; clos=>0
[5] category=Final exam; type=Final exam; weight=40.0; duration=60'; question_type=CLO1,CLO2,CLO3,CLO4,CLO5; grading_guide=concepts, algorithms;
all studied slides; completion_criteria=1) Every on-going assessment component > 0
2) Final Exam Score >= 4 & Final Result >= 5

Bonus score for accepted paper (email accepted/ published):
ISI/Scopus Q1, Q2: 5
ISI/Scopus Q3, Q4: 3
Scopus Q1, Q2: 3
Scopus Q3, Q4: 2

Source to check Scopus ranking: https://www.scimagojr.com/
Source to check ISI: https://mjl.clarivate.com; clos=4
[1] desc=Natural Language Processing and Computational Linguistics 1: Speech, Morphology and Syntax; author=Mohamed Zakaria Kurdi; publisher=Wiley; edition=; isbn=978-1848218482 (ISBN-13); main=True; online=True; note=https://library.books24x7.com
[2] desc=Spoken Language Processing; author=Joseph Mariani; publisher=Wiley; edition=; isbn=978-1848210318 (ISBN-13); main=; online=True; note=https://library.books24x7.com
[3] desc=Theory and Applications of Digital Speech Processing; author=Lawrence Rabiner, Ronald Schafer; publisher=Pearson; edition=; isbn=978-0136034285 (ISBN-13); main=; online=; note=
[4] desc=Speech and Language Processing; author=Daniel Jurafsky, James Martin; publisher=Prentice Hall; edition=; isbn=978-0131873216 (ISBN-13); main=; online=; note=
Session 1: Course introduction:
Introduce the materials of the courses and how to asses these materials
Introduce the assignments and how to pass the course
Topic: Offline; Teaching type: CLO1; LO: IT
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Materials: mat1
Download: Read Slide and and Seft-Review

Session 2: 1. Introduction to Digital Speech Processing
1.1 The Speech Signal
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 3: 1. Introduction to Digital Speech Processing
1.2 The Speech Stack
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 4: 1. Introduction to Digital Speech Processing
1.3 Applications of DSP
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review
CLO2: Develop expertise in speech recognition and synthesis, exploring and applying various algorithms for automatic speech recognition (ASR) and speech synthesis, including rule-based and statistical approaches
Session 1: 1. Introduction to Digital Speech Processing
1.4 Summary
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 2: 2. Review of Fundamentals of DSP
2.1 Discrete-Time Signals and Systems
Assignment 1 Introduction
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 3: 2. Review of Fundamentals of DSP
2.2 Transform Representation of Signals and Systems
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 4: 2. Review of Fundamentals of DSP
2.3 Fundamentals of Digital Filters
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review
CLO3: Apply relevant machine learning algorithms and models to address speech-processing challenges, including feature extraction, classification, and other tasks within the speech context
Session 1: 2. Review of Fundamentals of DSP
2.4 Sampling and Summary
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 2: 3. Human Speech Production
3.1 The Process of Speech Production
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 3: Assignment 1 review
Topic: Offline; Teaching type: CLO1; LO: T
ITU: 
Download: Following Instructions

Session 4: 3. Human Speech Production
3.2 Short-Time Fourier Representation of Speech
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review
CLO4: Acquire practical skills by using and implementing widely-used speech-processing tools, software, libraries, and frameworks, such as Praat, HTK, or other relevant platforms
Session 1: 3. Human Speech Production
3.3 Acoustic Phonetics
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slides and and Seft-Review

Session 2: 3. Human Speech Production
3.4 Distinctive Features of The Phonemes English
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slides and and Seft-Review

Session 3: 4. Hearing, Auditory Models, and Speech Perception
4.1 The Speech Chain
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slides and and Seft-Review

Session 4: 4. Hearing, Auditory Models, and Speech Perception
4.2 Anatomy and Function of the Ear
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review
CLO5: Demonstrate the ability to assess speech-processing system performance, applying appropriate metrics to evaluate accuracy and efficiency in speech recognition and synthesis models. Critically analyze the strengths and limitations of various approaches
Session 1: 4. Hearing, Auditory Models, and Speech Perception
4.3 The Perception of Sound
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 2: 4. Hearing, Auditory Models, and Speech Perception
4.4 Auditory Models
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 3: 4. Hearing, Auditory Models, and Speech Perception
4.5 HSP Experiments
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 4: Assignment 1 review
Topic: Offline; Teaching type: CLO1; LO: T
ITU: 
Download: Following Instructions
Session 1: 5. Time-Domain Methods for Speech Processing
5.1 Short-Time Analysis of Speech
Topic: Offline; Teaching type: CLO2; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 2: 5. Time-Domain Methods for Speech Processing
5.2 Short-Time Energy and Short-Time Magnitude
Topic: Offline; Teaching type: CLO2; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 3: 5. Time-Domain Methods for Speech Processing
5.3 Short-Time Zero-Crossing Rate
Topic: Offline; Teaching type: CLO2; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 4: 5. Time-Domain Methods for Speech Processing
5.4 The Short-Time Autocorrelation Function
Topic: Offline; Teaching type: CLO2; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review
Session 1: 5. Time-Domain Methods for Speech Processing
5.5 The Modified Short-Time Autocorrelation Function
Topic: Offline; Teaching type: CLO2; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 2: 5. Time-Domain Methods for Speech Processing
5.6 The Short-Time Average Magnitude Difference Function
Topic: Offline; Teaching type: CLO2; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 3: 5. Time-Domain Methods for Speech Processing
5.7 Summary
Topic: Offline; Teaching type: CLO2; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 4: 6. Frequency-Domain Representations
6.1 Discrete-Time Fourier Analysis
Topic: Offline; Teaching type: CLO2; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review
Session 1: Assignment 1 Evaluation
Topic: Offline; Teaching type: CLO1; LO: U
ITU: 
Download: Presentations

Session 2: Progress Test 1
Assignment 2 Introduction
Topic: Offline; Teaching type: CLO1,CLO2; LO: 
ITU: Progress Test 1
Download: Test 1

Session 3: 6. Frequency-Domain Representations
6.2 Short-Time Fourier Analysis
Topic: Offline; Teaching type: CLO3; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 4: 6. Frequency-Domain Representations
6.3 Overlap Addition Method of Synthesis
Topic: Offline; Teaching type: CLO3; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review
Session 1: 6. Frequency-Domain Representations
6.4 Time-Decimated Filter Banks
Topic: Offline; Teaching type: CLO3; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 2: 6. Frequency-Domain Representations
6.5 Two-Channel Filter Banks
Topic: Offline; Teaching type: CLO3; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 3: Assignment 2 Review
Topic: Offline; Teaching type: CLO2,CLO3; LO: T
ITU: 
Download: Following Instructions

Session 4: 7. Linear Predictive Analysis of Speech Signals
7.1 Introduction
Topic: Offline; Teaching type: CLO3; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review
Session 1: 7. Linear Predictive Analysis of Speech Signals
7.2 Basic Principles of Linear Predictive Analysis
Topic: Offline; Teaching type: CLO3; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 2: 7. Linear Predictive Analysis of Speech Signals
7.3 Computation of the Gain of the Model
Topic: Offline; Teaching type: CLO3; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 3: 7. Linear Predictive Analysis of Speech Signals
7.4 Frequency Domain Interpretations
Topic: Offline; Teaching type: CLO3; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 4: 7. Linear Predictive Analysis of Speech Signals
7.5 The Prediction Error Signal
Topic: Offline; Teaching type: CLO3; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review
Session 1: 7. Linear Predictive Analysis of Speech Signals
7.6 Relation of LPA to Lossless Tube Models
Topic: Offline; Teaching type: CLO3; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 2: 8. Algorithms for Estimating Speech Parameters
8.1 Median Smoothing and Speech Processing
Topic: Offline; Teaching type: CLO3; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 3: 8. Algorithms for Estimating Speech Parameters
8.2 Speech-Background/Slience Discrimination
Topic: Offline; Teaching type: CLO3; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 4: 8. Algorithms for Estimating Speech Parameters
8.3 A Bayesian Approach to Voiced Detection
Topic: Offline; Teaching type: CLO3; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review
Session 1: 8. Algorithms for Estimating Speech Parameters
8.4 Formant Estimation
Topic: Offline; Teaching type: CLO3; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 2: Assignment 2 Review
Topic: Offline; Teaching type: CLO2,CLO3; LO: T
ITU: 
Download: Following Instructions

Session 3: 9. Text-to-Speech Synthesis Methods
9.1 Introduction
Topic: Offline; Teaching type: CLO4; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 4: 9. Text-to-Speech Synthesis Methods
9.2 Text Analysis
Topic: Offline; Teaching type: CLO4; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review
Session 1: 9. Text-to-Speech Synthesis Methods
9.3 Evolution of Speech Synthesis Methods
Topic: Offline; Teaching type: CLO4; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 2: 9. Text-to-Speech Synthesis Methods
9.3 Early Speech Synthesis Approaches
Topic: Offline; Teaching type: CLO4; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 3: 9. Text-to-Speech Synthesis Methods
9.4 Unit Selection Methods
Topic: Offline; Teaching type: CLO4; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 4: 9. Text-to-Speech Synthesis Methods
9.5 TTS Future Needs
Topic: Offline; Teaching type: CLO4; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review
Session 1: 9. Text-to-Speech Synthesis Methods
9.6 Visual TTS
Topic: Offline; Teaching type: CLO4; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 2: Assignment 2 Evaluation
Topic: Offline; Teaching type: CLO2,CLO3; LO: T
ITU: 
Download: Presentations

Session 3: 10. Automatic Speech Recognition and NLU
10.1 Introduction
Topic: Offline; Teaching type: CLO2, CLO5; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slide and and Seft-Review

Session 4: 10. Automatic Speech Recognition and NLU
10.2 Basic ASR Formulation
Topic: Offline; Teaching type: CLO2, CLO5; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slides and and Seft-Review
Session 1: 10. Automatic Speech Recognition and NLU
10.3 Overall Speech Recognition Process
Topic: Offline; Teaching type: CLO2, CLO5; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slides and and Seft-Review

Session 2: 10. Automatic Speech Recognition and NLU
10.4 User Interfaces (UI) and Multimodel UI
Topic: Offline; Teaching type: CLO2, CLO5; LO: T
ITU: Course Implementation
- Syllabus SLP301m
- Slides
Download: Read Slides and and Seft-Review

Session 3: Progress Test 2
Topic: Offline; Teaching type: CLO3,CLO4,CLO5; LO: T
ITU: Progress Test 2
Download: Test 2

Session 4: Summary All Slides, Tests, and Assignments
Topic: Offline; Teaching type: CLO1,CLO2,CLO3,CLO4,CLO5; LO: U
ITU: All Contents
Download: Review and Group Discussion