[major=AI | course_id=SEG301 | syllabus_id=12633 | semester=5 | combo=AI17_COM2.1 | title=Search Engines]
Course ID: SEG301
Title EN: Search Engines
Title VI: Công cụ tìm kiếm
Credits: 3.0
Prerequisites: CSD203, AIL303m
Description: The theory, creation, and use of text-based search engines are covered in this lecture-based course. The main content includes experimental assessment, representation of information demands and documents, several significant retrieval models, and statistical features of the text. Besides, the course covers typical components of commercial search engines, such as federated search, vertical search, tailored search results, and diversified search results.
Student tasks: - Students must attend at least 80% of contact slots in order to be accepted to the final examination.
- Student is responsible to do all exercises, assignments and labs given by instructor in class or at home and submit on time
- Use laptop in class only for learning purpose
- Promptly access to https://flm.fpt.edu.vn for up-to-date course information
Tools: No
Course type: traditional
Decision: 359/QĐ-ĐHFPT dated 04/09/2025
Approved date: 2025-04-09
CLO1: Understanding how search engines work: Students should be able to explain the underlying technology behind search engines, including the algorithms used to crawl, index and rank web pages.
[1] category=Assignment 1; type=on-going; weight=10.0; duration=45'; question_type=CLO1,CLO3; grading_guide=- cover content 1-3; completion_criteria=; clos=>0
[2] category=Assignment 2; type=on-going; weight=10.0; duration=45'; question_type=CLO1,CLO3,CLO5; grading_guide=- cover content 3 - 9; completion_criteria=; clos=>0
[3] category=Assignment 3; type=on-going; weight=10.0; duration=45'; question_type=CLO1,CLO2,CLO4; grading_guide=- cover content 9 - ends; completion_criteria=; clos=>0
[4] category=Progress test 1; type=on-going; weight=15.0; duration=20'-30'; question_type=CLO1,CLO3,CLO4; grading_guide=- cover content chapter 1 -6; completion_criteria=; clos=>0
[5] category=Progress test 2; type=on-going; weight=15.0; duration=20'-30'; question_type=CLO1,CLO2,CLO4,CLO5; grading_guide=- cover content 7 - ends; completion_criteria=; clos=>0
[6] category=Final exam; type=Final exam; weight=40.0; duration=60'; question_type=CLO 1,2,3,4,5; grading_guide=concepts, algorithms;
all studied slides; completion_criteria=1) Every on-going assessment component > 0
2) Final Exam Score >= 4 & Final Result >= 5

Bonus score for accepted paper (email accepted/ published):
ISI/Scopus Q1, Q2: 5
ISI/Scopus Q3, Q4: 3
Scopus Q1, Q2: 3
Scopus Q3, Q4: 2

The accepted paper must be related to topics in AI17_COM2 and be assessed by the in-class Lecturer.

Source to check Scopus ranking: https://www.scimagojr.com/
Source to check ISI: https://mjl.clarivate.com; clos=4
[1] desc=Search Engines: Information Retrieval in Practice; author=Bruce Croft, Donald Metzler, Trevor Strohman; publisher=Pearson; edition=; isbn=978-0136072249 (ISDBN-13); main=; online=; note=
[2] desc=Introduction to Information Retrieval; author=Christopher D. Manning, Prabhakar Raghavan and Hinrich Schütze; publisher=Cambridge University Press; edition=; isbn=521865719; main=; online=; note=
[3] desc=Information Retrieval: Implementing and Evaluating Search Engines; author=Stefan Buttcher, Charles L. A. Clarke, Gordon V. Cormack; publisher=MIT Press; edition=; isbn=978-0262528870 (ISBN-13); main=; online=; note=
[4] desc=Web Information Retrieval; author=Stefano Ceri, Alessandro Bozzon, Marco Brambilla, Emanuele Della Valle, Piero Fraternali, Silvia Quarteroni; publisher=Springer; edition=; isbn=978-3642393136 (ISBN-13); main=True; online=True; note=https://library.books24x7.com/toc.aspx?bookid=77020
[5] desc=Understanding Information Retrieval Systems: Management, Types, and Standards; author=Marcia J. Bates; publisher=Auerbach Publications; edition=; isbn=978-1439891964 (ISBN-13); main=True; online=True; note=https://library.books24x7.com/toc.aspx?bookid=47168
[6] desc=- PowerPoint Slides; author=; publisher=; edition=; isbn=; main=; online=; note=
[7] desc=- Assignments 1; author=; publisher=; edition=; isbn=; main=; online=; note=
[8] desc=- Assignments 2; author=; publisher=; edition=; isbn=; main=; online=; note=
[9] desc=- Assignments 3; author=; publisher=; edition=; isbn=; main=; online=; note=
[10] desc=- Quiz for Progress Tests; author=; publisher=; edition=; isbn=; main=; online=; note=
Session 1: Course introduction:
- Introduce the materials of the courses and how to asses these materials
- Introduce the assignments and how to pass the course
Topic: Offline; Teaching type: CLO1; LO: IT
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: mat1
Download: Read Slide and and Seft-Review

Session 2: 1. Information retieval and search engines:
1.1 Information retrieval
1.2 Search engines
1.3 Search engineers
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 3: 1.4 Web Search
1.5 Other Search Applications 3
1.6 Other IR Applications
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 4: Chapter 1 exercises and review
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review
CLO2: Search engine optimization: Students should be able to apply best practices for optimizing web pages to improve their visibility in search engine results pages (SERPs).
Session 1: 2. Architecture of a seach engine
2.1a Basic IR System Architecture
2.1 Building blocks: Text acquisition, Text transformation, Index Creattion
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 2: 2.1 Building blocks (cont.): User Interaction, Ranking, evaluation
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 3: Chapter 2 exercises and review
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 4: 3 Crawls and Feeds
3.1 What to search.
3.2 Crawling the Web: Retrieving web pages, web crawler, freshness, Crawling, deep web, sitemaps, distributed crawling
Topic: Offline; Teaching type: CLO1, CLO3; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review
CLO3: Keyword research: Students should be able to conduct keyword research to identify the most relevant and profitable keywords by using popular retrieval models..
Session 1: 3.2 Crawling the Web(cont.): Crawling, deep web, sitemaps, distributed crawling
3.3 Crawling documents and email,
Topic: Offline; Teaching type: CLO1, CLO3; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 2: 3.4 docmuneta feeds.
3.5 Conversion problem: character encodings
3.6 Storing the documents: using database system, random access, compression and large files, update, big table
Topic: Offline; Teaching type: CLO1, CLO3; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 3: 3.7 Detecting duplicates
3.8 Remove noise
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 4: Chapter 3 exercises - review
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review
CLO4: Analytics and tracking: Students should be able to use analytics tools to track website traffic, user behavior, and campaign performance.
Session 1: Assignment 1
Topic: Offline; Teaching type: CLO1; LO: U
ITU: Content 1-6
Materials: drive.google.com
Download: Read Slides and and Seft-Review

Session 2: Review Assignment 1
Topic: Offline; Teaching type: CLO1; LO: 
ITU: Assignment 1
Materials: drive.google.com
Download: Assignment 1

Session 3: 4 Processing text
4.1 From Words to Terms
4.2 Text statistics
4.3 Document parsing: Tokenizing, stopping, stemming, phrases and N-grams
Topic: Offline; Teaching type: CLO1,CLO3; LO: U
ITU: Assignment 1
Materials: drive.google.com
Download: Review Assignment 1

Session 4: 4.4 Document structure and markup.
4.5 Link analysis: anchor text, pagerank, link quality
Topic: Offline; Teaching type: CLO1,CLO3; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review
CLO5: Solving problems: Students should be able to apply search engine techniques to solve the real-life problems
Session 1: 4.6 Information Extraction: Hidden Markov models for extraction
Topic: Offline; Teaching type: CLO1,CLO3; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 2: Chapter 4 exercises and review
Topic: Offline; Teaching type: CLO1,CLO3; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 3: 5. Ranking with indexes.
5.1 Abstract model of raking
5.2 Inverted Indexes: documents, counts, positions, fields and extents, scores, ordering
5.2b Implementing Inverted Indices
Topic: Offline; Teaching type: CLO1, CLO3, CLO4; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 4: 5.3 Compression: entropy and ambiguity, data encoding, bit-aligned codes, byte-aligned codes,
Topic: Offline; Teaching type: CLO1, CLO3, CLO4; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review
Session 1: 5.3 Compression (cont.): compression in practice, looking ahead, skipping and skip pointers
5.4 Axuiliary structures
Topic: Offline; Teaching type: CLO1, CLO3, CLO4; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 2: 5.5 Index construction: simple construction, merging, parallelism and distribution, update
Topic: Offline; Teaching type: CLO1, CLO3, CLO4; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 3: 5.6 Query processing: Document-at-a-time evaluation, term-at-a-time evaluation, optimization techniques,
Topic: Offline; Teaching type: CLO1, CLO3, CLO4; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 4: 5.6 Query processing (cont.): structured queries, distributed evaluation, caching, Impact Ordering, static index pruning
Topic: Offline; Teaching type: CLO1, CLO3, CLO4; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review
Session 1: Chapter 5 exercises and review
Topic: Offline; Teaching type: CLO1, CLO3, CLO4; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 2: 6 Queries and interfaces
6.1 Information needs and queries
6.2 Query Transformation and refinement: stopping and stemming revisited, spell checking and sugguestions,
Topic: Offline; Teaching type: CLO1, CLO3; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 3: 6.2 Query Transformation and refinement (cont.): query expansion, relevance feedback, context and personalization
Topic: Offline; Teaching type: CLO1, CLO3; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 4: 6.3 Showing the results: result pages and snippets, advertising and search, clustering the results
6.4 Cross-language search
Topic: Offline; Teaching type: CLO1, CLO3; LO: T
ITU: Content 1-5
Materials: drive.google.com
Download: Read Slide and and Seft-Review
Session 1: Chapter 6 exercises and review
Topic: Offline; Teaching type: CLO1, CLO3; LO: U
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slides and and Seft-Review

Session 2: Progress Test 1 - Review the Test 1
Topic: Offline; Teaching type: CLO1; LO: 
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Test 1

Session 3: 7. Retrieval Models
7.1 Boolen retrieval, Proximity Ranking and vector space model
7.2 Probabilistic models: Information retrieval as classification, BM25 Ranking Algorithm
Topic: Offline; Teaching type: CLO1, CLO4; LO: U
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Review Test 1

Session 4: 7.3 Ranking based on Language models: Query likelihood ranking, relevance models and pseudo- relevance feedback
Topic: Offline; Teaching type: CLO1, CLO4; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review
Session 1: 7.4 Complex queries and combining evidence: The inference Network model, the Galago Query Language
7.5 Web search
Topic: Offline; Teaching type: CLO1, CLO4; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 2: 7.6 Machine learning and information retrieval: learning to rank. Topic models and vocabulary mismatch
7.7 Application-based models
Topic: Offline; Teaching type: CLO1, CLO4; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 3: Chapter 7 exercises and review
Topic: Offline; Teaching type: CLO1, CLO4; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 4: 8 Search Engine Optimization (SEO)
8.1 The Importance of Search Engine Optimization
8.2 Fundamentals of Search Engine Optimization: Content, Architecture, HTML, Trust, Links, User-Related Factors, Toxins, Vertical Search Engines
Topic: Offline; Teaching type: CLO1, CLO2; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review
Session 1: 8.3 Search Engine Optimization and Spam
8.4 The Role of Ranking Updates
8.5 Search Engine Optimization for Special Collections
8.6 The Position of Search Engine Providers
Topic: Offline; Teaching type: CLO1, CLO2; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 2: Chapter 8 exercises and review
Topic: Offline; Teaching type: CLO1, CLO2; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 3: 9. Evaluating search engines
9.1 Why "Evaluate"?
9.2 Evaluation corpus
9.3 Logging
9.4 effectiveness metrices: recall and precision, average and terpolation, focusing on the top documents, using preferences
Topic: Offline; Teaching type: CLO1, CLO3, CLO4; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 4: 9.5 Efficiency metrics
9.6 Training, testing and statistics: significance tests, setting parameter values, Online testing
Topic: Offline; Teaching type: CLO1, CLO3, CLO4; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review
Session 1: Chapter 9 exercises and review
Topic: Offline; Teaching type: CLO1, CLO3, CLO4; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 2: Assignment 2
Topic: Offline; Teaching type: CLO1; LO: T
ITU: Assignment 2
Materials: drive.google.com
Download: Assignment 2

Session 3: Review Assignment 2
Topic: Offline; Teaching type: CLO1; LO: U
ITU: Assignment 2
Materials: drive.google.com
Download: Review Assignment 2

Session 4: 10 Classification and clustering
10.1 classification: Navie bayes, Support vector machines, Evaluation, Classfier and feature selection, spam, sentiment and online advertising
Topic: Offline; Teaching type: CLO1, CLO4; LO: 
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review
Session 1: 10 Classification and clustering
10.1 classification: Navie bayes, Support vector machines, Evaluation, Classfier and feature selection, spam, sentiment and online advertising
Topic: Offline; Teaching type: CLO1, CLO4; LO: U
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 2: 10.2 Clustering: Hierachical and K-meas clustering, K-nearest neighbor clustering, evaluation, how to choose K, clustering and Seach
Topic: Offline; Teaching type: CLO1, CLO4; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 3: 10.2 Clustering: Hierachical and K-meas clustering, K-nearest neighbor clustering, evaluation, how to choose K, clustering and Seach
Topic: Offline; Teaching type: CLO1, CLO4; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 4: Chapter 10 exercises and review
Topic: Offline; Teaching type: CLO1, CLO4; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review
Session 1: 11. Social search
11.1 What is Social search?
11.2 User Tags and Manual Indexing: Searching Tags, Inferring Missing Tags,Browsing and Tag Clouds
Topic: Offline; Teaching type: CLO1, CLO5; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 2: 11.3 Searching with Communities: What Is a Community?, Finding Communities, Community-Based Question Answering, Collaborative Searching
Topic: Offline; Teaching type: CLO1, CLO5; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 3: 11.3 Searching with Communities: What Is a Community?, Finding Communities, Community-Based Question Answering, Collaborative Searching
Topic: Offline; Teaching type: CLO1, CLO5; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 4: 11.4 Filtering and Recommending: Document Filtering, Collaborative Filtering
11.5 Peer-to-Peer and Metasearch: Distributed Search, P2P Networks
Topic: Offline; Teaching type: CLO1, CLO5; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review
Session 1: Chapter 10 exercises and review
Topic: Offline; Teaching type: CLO1, CLO5; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 2: 12 Beyond bag of words
12.1 Feature-Based Retrieval Models
12.2 Term Dependence Models
Topic: Offline; Teaching type: CLO1, CLO5; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 3: 12.3 Structure Revisited: XML Retrieval, Entity Search
12.4 Longer Questions, Better Answers
12.5 Words, Pictures, and Music
12.6 One Search Fits All?
Topic: Offline; Teaching type: CLO1, CLO5; LO: T
ITU: Course Implementation
- Syllabus SEG301m
- Slides
Materials: drive.google.com
Download: Read Slide and and Seft-Review

Session 4: Chapter 12 exercises and review
Topic: Offline; Teaching type: CLO1, CLO5; LO: U
ITU: Content 16-28
Materials: drive.google.com
Download: Read Slides and and Seft-Review
Session 1: Progress Test 2 - Review Progress Test 2
Topic: Offline; Teaching type: CLO1; LO: U
ITU: Assignment 3
Materials: drive.google.com
Download: Review Test 2

Session 2: Assignment 3
Topic: Offline; Teaching type: CLO1; LO: 
ITU: Progress Test 2
Materials: drive.google.com
Download: Review Test 2

Session 3: Review Assignment 3
Topic: Offline; Teaching type: CLO1; LO: U
ITU: Contents 23-28
Materials: drive.google.com
Download: Assignment 3

Session 4: Summary All Slides, Tests, and Assignments
Topic: Offline; Teaching type: CLO1; LO: U
ITU: All Contents
Materials: drive.google.com
Download: Review and Group discussion