CPIC’s MT Development: Current
Status and Future Directions

WANG Dan
China Patent Information Center, SIPO
Dec. 10, 2010, TOKYOO tliOutlineII.

BackgroundII.

IP5 Evaluation AnalysisyIII.

Tackling Quality ChallengeIV.

Future Directions

MT : Solution for Barrier-free Access to East
Asian Patent Information• PPatentt t application
li ti declines
d li
across the Western world• PCT applications in 2009:
Japan No.2, Korea No.4,
China No.5
No 5Source: WIPO

• Guidingg principle
pp of EPO’spatent information policy:
barrier-free access to patent
information (includinglanguages)

MT Language Pairs Underway
EPO

SIPO

FR/GE/SP/IT↔EN
SW/PT/NL/FI/GR/RO↔EN

CN-EN, EN-CN
JP-CN, KR-CN

JPO
KIPO
JP-EN, EN-JP
CN-JP, KR-JP

KR-EN, EN-KR, JP-KR
FR/GE/RU/CN-KR

USPTO
Systran for pre-examination;
MT tools available from other offices for examination

In service
Next
e t cacandidates
d datesSIPO’s Chinese to English MT Service (CPMT)
 Covering inventions
and utility models
 Updating 3 months
after publication

CPMT System Overview
Free of charge
g for the IP community
yFree Access Available on http://www.sipo.gov.cn/sipo_English
 And on http://www.cnpat.com.cn

On-the-fly CN-EN MT for claims and specifications
A Production
SystemTranslation
Engine Acceptedp
usabilityy for catchingg the ggist of CN ppatent information
 Further improvement in progress through testing the system

Customization of general purpose engines
 Employing semantic analyzing for effective disambiguation
 A rule-based engine in essence

CPIC’sCPIC
s MT Roadmap
By 2013
KR-CN

April, 2011
JP-CN

April, 2010
EN-CN

April 2008
April,
CN-EN

O tliOutlineII.

BackgroundII.

IP5 Evaluation AnalysisyIII.

Tackling Quality ChallengeIV.

Future Directions

Scores of Evaluation Results for JPO, KIPOand SIPO by EPO and USPTO•

Score of 3: The translation is not entirely understandable, but is actionable,yywith some critical information accuratelyy transferred. The text is stylisticallyor grammatically odd, but the language may still reflect a sound content to apatent professional.

Analysis of SIPO’s Score
Different Development Stages
 Machine translation @ JPO and KIPO: more mature services as result of earlier launching SIPO’ CN-EN MT powered by CPIC’s engine: still undergoing improvement

Influence of Evaluation Organization
 No source language sentences are considered during evaluation
 No pre-edited texts are used in the process of Chinese to English machine translation
 CPIC’s earlier development efforts were focused on grammatical output of the engine

Difficulty of Chinese to English Translation
 Japanese & Korean: hypotactic languages, Chinese: a paratactic one Japanese & Korean contain much more morphological information than ChineseO tliOutlineII.

BackgroundII.

IP5 Evaluation AnalysisyIII.

Tackling Quality ChallengeIV.

Future Directions

Plan for Quality Improvement

Evaluation
Methodology

To explore
pan appropriate
pp pqquality
y evaluation
methodology; and to formulate standards foreach language pair(C2E, E2C)

EngineCustomization

To apply the methodology in the“test-evaluate-improve” cycle of MT
engine customization

Domain Terms
Addingg

Add terms through user’s feedbacks,
active testing and human translation

Exploration for Better Evaluation Methodology
ExpectedRole

A tool useful for:
 Monitoring results of system development and improvement process Selecting MT engine in introducing new language pairs

Appropriate Evaluation for “Improvement” instead for “Evaluation” itself

Sufficient
ExpectedFeatures Adequate number of check-points, and diversity of test cases under one
checkpoint for system capability

Diagnostic
 Linguistically comprehensive for testing capabilities

Effective EfficientEffi i t forf evaluationl ti workflow
kfld i development
duringdlt

Current Work on Check-point Taxonomy
C2E, E2C check-point taxonomies finished
Each taxonomy organized as a tree structure
Each leaf node is a check-point
check point representing a linguistic unit

Improvement of all taxonomies will be continued
Design of J2C check-point taxonomy in process
Checkpoint
Check-point
Taxonomy

LevelGroup
Check-point
Schematic view of numbering of check-points

Check Point Example 1: Solved
Check-point
Taxonomy

Levels

12

34

5

6

7

8……

Groups11

Check points
Check-points

12 13 14111 112 113 114 121 … 124

21 … 29……

31 … 35351 … 358

81 … 83……

831 832 833

SSource条指定水平线的像素数据的扫描级被有次序地存储在 个地址存储器中
一条指定水平线的像素数据的扫描级被有次序地存储在一个地址存储器中。

ReferenceA scanning level of pixel data for a given horizontal line is regularly stored in anaddress memory.

Last version ofMT

Article one
one, appoint the scanning stage of the pixel data of horizontal line
regularly to be saved in an address memory.

Current
version of MT

The scanning stage of the pixel data of an appointed horizontal line is regularly
saved in an address memory.

Check point 351 – 数量短语（Quantifier phrase）

Check Point Example 2: Unsolved
Check point 723 – 叠词（Repetitivepword）
Source基于设置为在每个时间调度帧中一帧一帧地提供多种类别的
内容的提供时间表，将与请求时间相匹配的在时间调度帧中
提供的多种内容顺序提供给客户ＰＣ４。

Reference

Many kinds of contents to be provided in a time schedule frame
matching the time demanded are sequentially provided to aclient PC (4) based on a providing schedule set up to provide
plural kinds of contents in each time schedule frame one by one.
one

Last version ofMT

Based on setting up as the timetable that provides that provides
to a frame content of multiple classification in every time
dispatch frame, will offer customer PC4 in proper order with themultiple content that provides of request time phase‐match intime dispatch frame.

Currentversion of MT

Based on setting up as the timetable that provides that one by
one provides the content of multiple classification in every
dispatch frame time, will with the dispatching the multiple
content that provides in the frame in the time and offer
customer PC4 in proper order of request time phase‐match.

Current Work on Engine Customization
Engine customization of all 3 language pairs in processStandardized workflow of “Test→Evaluate→Improve” cycles to be continued byapplying
l i ththe quality
lit standards
t d dError feedbacks to be collected and addressed within the workflow

ParallelcorporaMTengine

Test

Extraction

Test suites

Evaluate

Improve & Retest

Check-point
DefinitionEvaluationd t bdatabaseAdding Terminology Though CAT Route
Language resources(Structural Trees,Parallel Corpus )PatentPt t
Document(Chinese)

MTEnginePatentPt t
Document(English)

CATEngine
Bilingual Dictionary (General Terms, Technical Terms,
Semantic Information, etc.)

Adding or updatingterms by translators

Integrating MT with CAT
Integration into translation production environment
 Making better usage of linguistic assets maintained by human translators accumulated
over the years
 AnA enhanced
hd mechanism
h if terminologyforti lcontrolt l andd additiondditi
 Less and less unknown terms for the machine translation engine

O tliOutlineII.

BackgroundII.

IP5 Evaluation AnalysisyIII.

Tackling Quality ChallengeIV.

Future Directions

Future Directions
Works ahead
Further quality
improvement

Towards otherlanguage pairs

Supporting SIPO’sCollaboration

 Continue the “Test –First priority: Japanese IP5-MMT ProjectEvaluate – Improve
Improve” cycle

and Korean to Chinese SIPO’s
SIPO’ cooperation
ti withith Enhancing results byOther language pair in theother IP offices

adding statistical andfuture

R&D Organizations

example-based
approaches

21

MT from and into Chinese: English as a Pivot?
Korean?
EnglishChineseJapanese?
14/34

E li h as a Pivot:
EnglishPi t Example
El 1
Route

Translation results

Source(JapaneseAbstract)

光吸収性反射防止構造体、それを備えた光学ユニット及びレンズ鏡筒ユニット、並びにそれらを備えた光学装置（修正有）【課題】反射が十分に抑制された光吸収性反射防止構造体を提供する。

Via
JapaneseEnglishChinese

吸收光防反射结构、光学装置和装备有同样透镜镜筒单元和光器件，其装备有它们
摘要：
被解决的问题：提供一次吸收光防反射结构其中反射令人满意地被压制。
解决方案：一个透镜镜筒的内部的圆周表面10作为具有一个大于入射光的波长表面粗度的一个粗糙表面被形成和在内部的圆周表面10上，定期地由一个比入射光的波长更小的周期排列成的多个粉末崎岖的部件11。每一崎岖的第11部分的粉末可以包括，例如， 凹部部分或 突起部分是基本上锥形(顶点部分可以是倒角或 刻槽的)，锥体或线性的(横断面形末可以包括，例如，一凹部部分或一突起部分是基本上锥形(顶点部分可以是倒角或R刻槽的)，锥体或线性的(横断面形状可以是三角的，不规则四边形，矩形的等)

DirectJ
JapaneseChinese光吸收性反射防止构造体，具备其光学单元及透镜透镜电子管单元，以及具备其光学装置（修正有）【课题】反射提供被充分抑制的光吸收性反射防止构造体。
【解决办法】透镜镜筒内周面10被形成比入射光的波长更大的表面粗糙度的粗面，在内周面10中，形成用入射光波长以
下的周期被有规则的排列的复数的微小凹凸部11。微小凹凸部11，例如，近似圆锥状，(顶部也可以倒角或被R倒角)，角锥台状，线状(断面形状，三角形状，梯形状，进行矩形状等)的凹部或凸部。

【解決手段】レンズ鏡筒の内周面 は入射光の波長よりも大きな表面粗さの粗面に形成されており、内周面 には、入射光【解決手段】レンズ鏡筒の内周面１０は入射光の波長よりも大きな表面粗さの粗面に形成されており、内周面１０には、入射光の波長以下の周期で規則的に配列された複数の微小凹凸部１１が形成されている。微小凹凸部１１は、例えば、略円錐状（頂部が面取り又はＲ面取りされていてもよい）、角錐台状、線状（断面形状が、三角形状、台形状、矩形状等）の凹部又は凸部でもよい。

E li h as a Pivot:
EnglishPi t Example
E
l 2
Route

Translation results

Source(JapaneseAbstract)

測位装置、測位装置の制御方法、その制御プログラム及び記録媒体【課題】信頼性を有し、かつ、精度の高い位置を出力することができる測位装置等を提供すること。
【解決手段】測位衛星からの信号である衛星信号に基づいて、測位を行う測位装置２０であって、参照位置Ｐを保持する位置保持手段と、参照位置Ｐが静止条件Ｂを満たすか否かを判断する静止条件判断手段と、静止条件Ｂを満たす参照位置Ｐと、測位によって算出した現在の測位位置Ｐｇを平均化して平均位置Ｐａｖを算出する平均位置算出手段と、平均位置Ｐａｖを出力する位置出力手段と、平均位置Ｐａｖを参照位置Ｐとして位置保持手段に格納する位置格納手段と、を有する。

Via
JapaneseEnglishChinese

标题：定位器、定位器的调节方法、其控制程序，和记录媒介
被解决的问题：提供一个定位器等，其可以输出一个位置高精度，与可靠性一起。
解决方案：定位器20执行一次定位，基于一个卫星信号从一个定位卫星。装置包括用于保持一个参考位置P的一个位置支持手段;静态条件决定方式，其决定是否参考位置P满足停止条件B;一个平位置计算装置，其计算平位置Pav，与满足通过定位计算的停止条件B和现在位置位置Pg的参考位置P的平均一起;输出平位置Pav的一个位置输出装置;一个位置存储器装置 其用于在位置支持手段中存储作为参考位置P的平位置Pav
个位置输出装置;一个位置存储器装置，其用于在位置支持手段中存储作为参考位置P的平位置Pav。

DirectJJapaneseChinese测定位置装置，测定位置装置的控制方法，该控制程序及进行记录媒体【课题】提供一种测定位置装置等，具有可靠性，且，能输出精度高的位置测定位置装置等。【解决办法】根据从定位课题 提供 种测定位 装 等 具有 靠性能输 精度高的位 测定位 装 等
解决办法 根据从定位
卫星来的信号的卫星信号，进行测定位置测定位置装置20，具有保持引用位置P的位置保持手段、及判断引用位置P是否满足静止条件B的静止条件判断手段、及满足静止条件B的引用位置P、及由测定位置平均化算出现在的测定位置位置
Pg，计算出平均位置Pav的平均位置计算方法、及输出平均位置Pav的位置输出手段、及作为引用位置P在位置保持手段存储平均位置Pav的位置存储手段。

Possible Benefits of Using English as a Pivot
Expected facilitation for MT system development and deployment
 MT engines to and from English already available

 English translations in JPO, KIPO and SIPO are pooled Technical terms are first written in English in many cases The approach already proved to be effective by the academic fieldThank you !