Project Modules
RSS Aggregator and News Article Downloader
 Periodically download news articles from a list of RSS files.
STATUS: Not started
News Article Downloader – Algorithms Connector
 Performs keyword extraction, topic discovery and classification, and category classification on
the downloaded articles.
STATUS: Not Started
Keyword Extraction
 Extract keywords from a news article.
STATUS: Completed
Category Classification
 Identify the categories a news article is in. The categories are Business, Politics, Sports,Entertainment, Health, Technology, and world regions as defined by the United Nations.
STATUS: Algorithm is completed, but need to gather more training data.
Topic Discovery and Classification
 Identify if a news article has the same topic as a previously seen article or if it contains a newtopic.
STATUS: Completed
Named Entity Recognition
 Identify the people, places, times, and dates in a news article.
STATUS: Not Started
Web Interface
 Provide an easy to use and friendly interface for navigating the news articles and exploring therelations between categories, topics, and named entities.
STATUS: Not Started

Project Plan1RSS Aggregator and News Article Downloader
 This part is important to the project and should be completed soon.
 The algorithms are simple and should be completed easily given time.
RECOMMENDATION: Assign to Teng or Hisazumi
COMPLETION TIME: 1-2 months for coding and debugging

2

News Article Downloader – Algorithms Connector
 This is an extension to the RSS Aggregator and News Article Downloader program.
RECOMMENDATION:
RSS Aggregator and News Article Downloader programmer and DavidCOMPLETION TIME: 1 month for coding and debugging

3Named Entity Recognition
 Involves finding an implementation that can run on windows and creating and interface to call theprogram/algorithm from within C#.
RECOMMENDATION: DavidCOMPLETION TIME: 1 month for coding and debugging

4Database Design and Implementation
 Involves designing the database that will be used to communicate between the web interface and thealgorithms.
RECOMMENDATION: Teng, Hisazumi, and DavidCOMPLETION TIME:
1 week5Server Setup Selecting, purchasing, installing, and configuring server(s) for the project.
 I would recommend 1 server for the interface and 1 server for the algorithms and database.
RECOMMENDATION: Teng or Hisazumi
COMPLETION TIME:
1 week for installation and configuration

6Web Interface
 Provide an easy to use and friendly interface for navigating the news articles and exploring therelations between categories, topics, and named entities.
 Should use UTF-8
RECOMMENDATION: Teng or Hisazumi
COMPLETION TIME: 2-3 months for design and implementation. (perhaps longer depending on thedesires of the customer.)

7Algorithm Refinement
 Testing and updating of the basic algorithms to improve accuracy and performance.
RECOMMENDATION: DavidCOMPLETION TIME: Until project ends

8Expansion to Japanese Currently the implementations of the algorithms in C# work with English and Japanese.
 Chasen is used for Japanese morphological analysis.
 Expansion to Japanese would require new training data for category classification and a named entity
recognizer for Japanese.
RECOMMENDATION: Hisazumi and DavidCOMPLETION TIME: 2-3 months for full testing and analysis

9Expansion to Chinese The algorithms work on any language that has a morphological analyzer.
 For Chinese, a new plugin for the algorithms would be needed that implements Chinesemorphological analysis.
 A Chinese named entity recognizer is also needed.
RECOMMENDATION: Teng and DavidCOMPLETION TIME: 5-6 months for full testing and analysis**Completion time means the time to complete if that is the only part of the project being done. It could
possibly take longer. I believe for all the parts listed within this document it would take about 1 year to complete
and have a functioning web site.