ISO/TC 37
Terminology and other language resourcesmanagement standards and application
CHOI, Key-Sun
NHK STRLKAIST Korterm(Korea Advanced Institute of Science & Technology)(Korea Terminology Research Center for Language & Knowledge Engineering)

ISO/TC 37/SC 4 Secretary
http://korterm.org/

TC 37 history• ISO/TC 37 N410 (Rev.) and TC 37/AG N26• 1936 founded as ISA/TC 37 “Terminology” in theInternational Federation of the National
Standardizing Associations (ISA)– Worked until 1939

• 1951 ISO/TC 37 “Terminology (principles andco-ordination” of the International Organizationfor Standardization (ISO)– Started to operate in 1952.

2002/11/29(c) Choi, Key-Sun

2

SC• SC1 Principles and methods– Principles of terminology (until 2001)• SC2 Terminography and Lexicography– Layout of vocabularies• SC3 Computer applications forterminology• SC4 Language resource management– (start from June/2002, Las Palmas)
2002/11/29(c) Choi, Key-Sun

3

Terminology Standards• Two meanings of “Terminology Standard”– “Vocabularies”• Terminology standards that contain subject-fieldspecific concepts and terms produced byterminology sub-committees on national, regional
and international level– Terminology-principles-and-methods
standards• Produced by specific committees on national andinternational level (ISO/TC37, JISC-NAT, …)
2002/11/29(c) Choi, Key-Sun

4

Vocabularies(Principles and Methods)
ISO 1087-1
Terminology – Vocabulary – Part 1

ISO 1087-2
Terminology work – vocabulary –Part 2: Computer Applications

ISO 1087-1 contents
IS O 1 0 8 7

0 1 /2 0 0 2

2002/11/29

Slide series about ISO 1087 adopted from K la u s - D ir k S c h m it z(c) Choi, Key-Sun

56ISO 1087-1 “Vocabulary”
IS O 1 0 8 7

0 1 /2 0 0 2

2002/11/29

K la u s - D ir k S c h m it z(c) Choi, Key-Sun

67

ISO 1087-1 Language and Reality
IS O 1 0 8 7

0 1 /2 0 0 2

2002/11/29

K la u s - D ir k S c h m it z(c) Choi, Key-Sun

78

Concept Orientation: Language
and Reality
Graphic series
Adopted from
Klaus-Dirk Schmitz“hammer”
2002/11/29(c) Choi, Key-Sun

9

Concept orientation: object

object“hammer”
2002/11/29(c) Choi, Key-Sun

10

Concept orientation: term

objectterm
2002/11/29(c) Choi, Key-Sun

11

Concept orientation: concept

concept

objectterm
2002/11/29(c) Choi, Key-Sun

12

Concept orientation: definition• Object– Any part of the perceivable or conceivable world• Objects may be material (e.g., engine) or immaterial (e.g.,magnetism)• Concept– Unit of thought made up of characteristics that are derived bycategorizing objects having a number of identical properties• Concepts are not bound to particular languages. They are, however,influence by social or cultural background.

• Term– Designation of a defined concept in a special language by alinguistic expression• A term may consist of one or more words.

2002/11/29(c) Choi, Key-Sun

13

Terminological entry
Graphic adopted fromSue Ellen Wright andKlaus-Dirk Schmitz

Term

Term

Concept
Term

Term
Term
2002/11/29

Term(c) Choi, Key-Sun

14

Terminological Entry: standardized
Graphic adopted fromSue Ellen Wright andKlaus-Dirk Schmitz

In standardized terminology:
only one (preferred) term !

Term

Term

Concept
Term(Term)(Term)
2002/11/29

Term(c) Choi, Key-Sun

15

Concepts in the Lexicon: Introduction
John F. Sowa
http://users.bestweb.net/~sowa/ontology/lexicon.htm
•

•

•

•

•

The lexicon is the bridge between a language and the knowledge expressed in that language. Everylanguage has a different vocabulary, but every language provides the grammatical mechanisms for
combining its stock of words to express an open-ended range of concepts. Different languages,
however, differ in the grammar, the words, and the concepts they express. The differences arise fromthree kinds of variation:
Accidental. The most obvious differences result from arbitrary choices of sounds, such as hand in
English and mano in Italian. Other variations depend on arbitrary choices of where to draw boundaries.
In English, hand refers to the part of the body from the fingertips to the wrist. But in Russian, thecorresponding word ruka extends all the way to the elbow.
Systematic. The grammar of a language determines how the conceptual structures are linearized as
strings of words in a sentence. English and Chinese, for example, put the subject first, the verb in the
middle, and the object at the end for an SVO word order. Irish and Biblical Hebrew are VSO languages
that put the verb first. Latin and Japanese are SOV languages that put the verb at the end. The
grammar also determines how the units of meaning, called morphemes, are combined to form words.
Chinese is an extreme example of an analytic language in which almost all the morphemes can beused as stand-alone words. German is an agglutinative language, which forms compound words like
Lebensversicherungsgesellschaftsangestellter (life insurance company employee). Old English was anagglutinative language like German, but as it evolved into modern English, it became almost as
analytic as Chinese.
Cultural. The concepts expressed by a language are determined by the environment, activities, andculture of the people who speak the language. Since French, Chinese, and Indian cuisines are basedon very different ingredients, methods of preparation, and cooking utensils, the people who cook andeat each kind of food use words for it that have no counterparts in the other cultures. The specialized
concepts, however, can be transferred with the culture whenever a cook opens a new restaurant in aforeign land. Cultural and conceptual shifts occur across time as well as space. A book on science orbusiness, for example, is easier to translate from modern English to modern Japanese than frommodern English to the language of Shakespeare.
Grammars and words belong to the province of linguistics, but the concepts they express belong to theextra-linguistic knowledge about the world. For each language, the lexicon must provide the links thatenable a language processor to carry messages from one province to the other.
2002/11/29(c) Choi, Key-Sun

16

Terminology work
T e rm E xtra ctio n
Adapted from
Klaus-Dirk Schmitz

0 1 /20 02

2002/11/29

K lau s-D irk S ch m itz(c) Choi, Key-Sun

18

17

(Vocabularies)
Principles and Methods
ISO 12620
ISO 12200
ISO DIS 16642

ISO/TC 37/SC 3• ISO 12620: Computer applications in
Terminology – Data Categories• ISO 12200: Computer applications in
Terminology – Machine-Readable Terminology
Interchange Format (MARTIF) – NegotiatedInterchange• ISO DIS 16642: Computer applications interminology – Meta model for representing
terminological data collections / Terminology
mark-up framework
2002/11/29(c) Choi, Key-Sun

19

ISO 12620 (Data Categories)• Inventory of more than 200 data categories used interminological data collections:– A.1 term
– A.2 term-related information– A.3 equivalence– A.4 subject field– A.5 concept-related description– A.6 concept relation– A.7 conceptual structures– A.8 note
– A.9 documentary language– A.10 administrative information– Annex B (informative): Bibliographical data categories
2002/11/29(c) Choi, Key-Sun

20

ISO 12620 (Data categories) ex.
•
•
•
•
•

A.2.2.1 part of speech
NONADMITTED TERM1: grammatical category
NONADMITTED TERM2: word class
DESCRIPTION: A category assigned to a word basedon its grammatical and semantic properties
PERMISSIBLE INSTANCES: Examples of parts ofspeech commonly documented in terminology
databases can include:A) nounB) verb
C) Adjective–

On the basis of a study and analysis of a great variety
of practical applications; can be amended

2002/11/29(c) Choi, Key-Sun

21

ISO 12620 new• Metadata Registry– Contains terms that describe database fields– For describing and comparing databases– For human use– “concept-oriented” but referring to objects(fields) that are IT representations of (real)
objects/concepts– ISO JTC1/TC32 provides a standard for
metadata registries
2002/11/29(c) Choi, Key-Sun

22

ISO 12620 new – metadata registry• Converting ISO 12620:1999 data category
description into metadata registry format• Using the DCS-Editor, developed within theframework of the SALT Project, for thedescription of the data categories• Create the list of datCats and the description of
datCats directly by the DCS-Editor as anormative annex of the new ISO 12620• The body defines the (metadata) description
format2002/11/29(c) Choi, Key-Sun

23

DCS-Editor: SALT Project
ISO 12620 new

01/2002

2002/11/29

Graphic
adapted from
Klaus-Dirk Schmitz

Klaus-Dirk Schmitz 26(c) Choi, Key-Sun24part of speech
Identifying and Definitional Attributes
Data Element ID: ISO12620A020201 Version No: 1
Data Element Name: part of speech
Type: Data Element
Status: Current 12-DEC-1999
Admitted Name:
Non-admitted Name 1: grammatical category
Non-admitted name 2: word class
Definition: A category assigned to a word based on its
grammatical and semantic properties
Source-related Comment:
Concept-related
Comment:
Example:Dictionary ID: A.2.2.1
2002/11/29(c) Choi, Key-Sun

25

(Vocabularies)
Principles and Methods - 2• ISO 12620• ISO 12200: Computer applications in
Terminology – Machine-Readable
Terminology Interchange Format(MARTIF) – Negotiated Interchange• ISO DIS 16642: Computer applications interminology – Meta model for representing
terminological data collections /Terminology mark-up framework
2002/11/29(c) Choi, Key-Sun

26

Terminology Representation
Formats• Multitude of formats for
lexical/terminological data
– E.g, MATER, TEI-lex/term, NTRF,OLID,
MARTIF, TBX, IIF, TRANSTERM, GENETER• MARTIF negotiated (ISO 12200)• MARTIF specified MSC (ISO CD 16503;
frozen)• GENETER (ISO CD 17241; frozen)• Meta-Model / TMF (ISO DIS 16642)
2002/11/29(c) Choi, Key-Sun

27

TMF / XLT / TBX• Terminology Markup Framework (TMF)– Defines a framework for terminology interchange /representation languages (TMLs): Meta Model, DCSEditor, Style– TMLs: Unicode, XML-based format• Family of formats for lexical and terminological
data (XLT)– Subset of ISO 12620 datcats, specific style (MARTIFlike– DXLT (Default XLT) = TBX of LISA
2002/11/29(c) Choi, Key-Sun

28

Meta ModelMeta Model

01/2002

2002/11/29

Klaus-Dirk Schmitz 35(c) Choi, Key-Sun

29

ISO-TMS• ISO 704
• Wright/Budin “Handbook of Terminology
Management, Vol I and II”• Concept-oriented approach of terminology
management

2002/11/29(c) Choi, Key-Sun

30

Term autonomy principle• Each term representing the (same)
concept could be managed autonomously• Could be Documented necessary termrelated data categories

2002/11/29(c) Choi, Key-Sun

31

Data categories• ISO 10241 “Preparation and layout ofinternational terminology standards”• ISO 12620 “Computer Applications in
Terminology – Data Categories”

2002/11/29(c) Choi, Key-Sun

32

Templates• For producing working drafts and the final
standard directly from the ISO-TMS arenecessary.

2002/11/29(c) Choi, Key-Sun

33

Experts’ discussions• Maintenance of provisional andintermediate results of the experts’discussions and decisions is of great
importance.
• Work “history” maintenance– To trace and backtracking previous decisions
and results

2002/11/29(c) Choi, Key-Sun

34

ISO-TMS database design
Data categories with * need• history function• repeatabledefinition *example *note *
seeterm typenormative auth.
part of speechgram. gendergram. number
verbal feature
subject
field
2002/11/29

entry identifier
creation date + userchange date + user
standard number + year
ISO committee +document
concept identifier *internal note"concept"

EnglishFrench

term
term

term
term

term *

term *(c) Choi, Key-Sun

definition *example *note *
seeterm typenormative auth.
part of speechgram. gendergram. number
verbal feature
subject field
35

Extensions from TC 37/SC 3
to SC 4
• To develop a standard for data categories
used in typical “SC 4 applications”• May-be with different parts for different
types of language resources (NLP lexica,
texts, speech, etc.)• May-be with different meta-models fordifferent types of language resources• Method: “learn from TMF history”
2002/11/29(c) Choi, Key-Sun

36

References• MARTIF, ISO 12620 Data Categories,
MSC, Meta-Model, TBX: www.ttt.org• SALT Project: www.loria.fr/projets/SALT

2002/11/29(c) Choi, Key-Sun

37

ISO TC 37 / SC4
Language Resource
Management
An overview
Laurent Romary

Standards for language
processing
Primary resources(text, dialogues)
Structural mark-up
Basic annotations[TEI, MPEG7, TMX(XHTML…), etc.]

Access protocols[Corba, SOAP]

Knowledge structures
Hierarchies of types
Relations between concepts(subjects/topics etc.)
Links to primary resources[Topic Maps, OWL, RDF]

Links
NLP structures
Lexical structures(annotations)(Language models)
POS tagging
Terminologies
Chunks (cf. Named Entities)
Transfer lexica
Deep Syntactic structures
LTAG/HPSG/LFG lexica
Co-references etc.
[TBX, OLIF,
Meta-data[Eagles/ISLE,
Eagles/ ISLE (Genelex)]
CES, MATE/NITE,…] [Dublin core, OLAC,
ISLE, MPEG7, RDF]

2002/11/29(c) Choi, Key-Sun

39

10 years ahead…
• Training a stochastic parser– And evaluating it…

• Putting together an information extraction
system– And evaluating it…

• Parameterizing an MT system– And…

• Putting together a man-machine dialoguesystem in the context of an EU/NSF/national etc.
project (e.g. Smartkom, MIAMM, …)
2002/11/29(c) Choi, Key-Sun

40

Context• ISO TC37 - Terminology and otherlanguage resources– SC3 - Computer applications in terminology• ISO 12200 - Martif– Latest version of TEI Terminology chapter• ISO 12620 - Data categories (under revision)• ISO DIS 16642 - TMF (Terminological Markup
Framework)– SC4 - Language resources
2002/11/29(c) Choi, Key-Sun

41

Goals of ISO / TC 37/SC 4• prepare international standards/guidelines for
effective language resource management inmono- and multi-lingual applications• develop principles and methods for creating,coding, processing and managing language
resources– written corpora, lexical databases, spoken language
corpora, etc.

• Focus :– data modeling (à la MPEG7?)– data exchange, evaluation
2002/11/29(c) Choi, Key-Sun

42

TC37/SC4 details• Scope– Platform for designing and implementing linguistic resource formats andprocesses• Multi-layer annotation of linguistic resources• Exchange of information between NLP modules• General strategy– Involve a wide community from academia and industry• through national standardizing bodies• Agenda– Constituency meeting and technical workshop at LREC (May 2002)– Current:• identification of possible work items and working groups• Implication of new experts and work agenda planning

2002/11/29(c) Choi, Key-Sun

43

Organization• Chair:– Laurent Romary, France• Secretary:– Key-Sun Choi, Korea• International Advisory Committee– Permanent Chair: Prof. Antonio Zampolli, Italy

2002/11/29(c) Choi, Key-Sun

44

SC4 and other standardizing
bodiesContributing organizations
TEI-text representation
Reference for primary sources
e.g.: text archives

Text

W3C
-basic protocols and formats
XML (Schemas)
XPath, XPointer, XLink+ RDF, SVG, SMIL,
OWL, SOAP----- ACL--------Oscar
ELSNET

ISO TC37/SC4
Technical background- language resources, NLP perspective
e.g. linguistic annotations,lexical formats

MPEG- Multimedia, XML based
e.g. MPEG7-4
Word and phone lattices
2002/11/29

Audio/Speech(c) Choi, Key-Sun

45

TC37/SC4 overall rationale

Lexical databases

WG3

Representation schemes

Multilingual text representation

WG1
Basic descriptors and mechanisms
for language resources

2002/11/29(c) Choi, Key-Sun

WG5

WG2

Workflow of language Resource Management

WG4

46

TC37/SC4 Work Items• WG1– PWI: Terminology of Language Resources– PWI: Linguistic annotation framework– PWI: Meta-data for multimodal and multilingual
information• WG2– PWI: Structural content representation scheme– PWI: Multimodal content representation scheme– PWI: Discourse level representation scheme

2002/11/29(c) Choi, Key-Sun

47

TC37/SC4 Work Items - cont.
• WG3– PWI: Translation Memory, Alignment of parallel corpora– PWI: Segmentation and counting algorithms (characters, words,
sentences etc.)– PWI: Meta-markup for GIL (Globalization, Internationalizationand Localization)• WG4– PWI: NLP Lexica• WG5– PWI: Validation of language resources– PWI: Net-based distributed cooperative work for the creation of
language resources

2002/11/29(c) Choi, Key-Sun

48

Report on WG1 activities• WI: Terminology of language resources– Basic requirements - K.-D. Schmitz– Existing sources for bootstrapping a TermBank in
SC4 - K.-S. Choi (proj. leader)• WI: Linguistic Annotation Framework– data categories for lang. res. - S.E.Wright– Basic requirements and workplan - N. Ide (proj.
leader)• TF: Meta-data for multimodal and multilingual
information– Task description and scope - P. Wittemburg (rep. By
L. Romary)
2002/11/29(c) Choi, Key-Sun

49

Report on WG1 activities (cont.)• Related activities– Semantic content representation - K.-Y. Lee– Dialogue architectures - L. Romary–…

2002/11/29(c) Choi, Key-Sun

50

WG1 - PWI• Terminology of Language Resources– Basic terminology of the various sub-fields oflanguage resources and general methodology– Possible sources:• ISO 1087
• LREC proceedings + KAIST• Support from GTW

2002/11/29(c) Choi, Key-Sun

51

WG1 - PWI• Linguistic annotation framework– Basic mechanisms and data structures for linguistic annotation andrepresentation [data architecture]
•
•
•
•
•

Methods and principles for the design of an annotation scheme
Structural nodes and information units, Data category specification
Linking and pointing mechanisms, Feature Structures, Meta-Markup« Stand-off » and « in-line » views - equivalences, combining levels.
Administrative data categories– Possible sources:• TMF, iso12620-revised, Mate/NITE (general methodology)• TEI (Linking mechanisms, feature structures)• Link with Linguistic DS

2002/11/29(c) Choi, Key-Sun

52

WG1 - PWI• Meta-data for multimodal and multilingual
information– Description of a meta-data representation scheme to
document linguistic information structures andprocesses• General content description• Local content description– Possible sources:• OLAC, Mile, TEI Header– Liaison: TC46 (SC9), MPEG7/MDS, SCORM

2002/11/29(c) Choi, Key-Sun

53

WG2 - PWI• Structural content representation scheme– Definition of annotation/representation scheme(s)for morpho-syntax and syntax, to be used forannotation and interchange purposes• Meta-model for morpho-syntactic annotation• Meta-model(s) for syntactic annotation (lexicalized
grammar, elementary trees, dependancy structures)• + corresponding Data category registries– Possible sources:• Eagles, TAGML, Linguistic DS• SIGPARSE

2002/11/29(c) Choi, Key-Sun

54

WG2 - PWI• Multimodal meaning representation scheme– Representation scheme for the semantic content ofmultimodal information (textual, spoken, graphical andgestural)• Meta-modal for content representation (Events,
participants, etc.)• Data category registry for multimodal content– Possible sources:• SIGSEM working group on semantic content– Chair: Harry Bunt

– « Liaison »• Semantic web activities

2002/11/29(c) Choi, Key-Sun

55

WG2 - PWI• Discourse level representation scheme• Meta-model for discourse and dialogue
representation• Meta-model for discourse level annotation (e.g.
reference annotation)• + corresponding DatCat registry– Possible sources:• SIGDIAL• DRI - Discourse Resource Initiative• Mate2002/11/29(c) Choi, Key-Sun

56

WG3 - PWI• Translation Memory, Alignment of parallel corpora– Provides formats for the representation of multilingual
textual data as produced in translation activities orconstructed from existing primary sources– Sources:• OSCAR/TMX for translation memories• TEI based linking mechanism (or see WI-1) for Paralleltexts

2002/11/29(c) Choi, Key-Sun

57

WG3 - PWI• Segmentation and counting algorithms(characters, words, sentences etc.)– Provide methods for segmenting streams of text
with markup and means to for counting thecorresponding segments– Possible sources:• OSCAR2002/11/29(c) Choi, Key-Sun

58

WG3 - PWI• Meta-markup for GIL (Globalization,
Internationalization and Localization)– Identification of the specific markup modules
needed to perform GIL activities– Possible sources:• OSCAR/OpenTag

2002/11/29(c) Choi, Key-Sun

59

WG4 - PWI• NLP lexica– Lexicon representation formats for the various types
of NLP applications (Machine Readable Lexica)• Define a set of meta-models (classes of applications)• Specific data categories (derivation, phonology, etc.)• Based on the work done in other work items– Possible sources• Eagles, Multext, ISLE Computational lexicon Working
group, OLIF

2002/11/29(c) Choi, Key-Sun

60

WG5 - PWI• Validation of language resources– Defines guidelines and requirements for
producing and distributing high quality
language resources– Contacts:• ELRA, TEI– Possibles sources:• To be defined

2002/11/29(c) Choi, Key-Sun

61

WG5 - PWI• Net-based distributed cooperative work for thecreation of LRs– Principles and methods for designing collaborativeand cooperative compilation of LRs– Define what is specific to LRs with regards• Tracability of resources, version control, validation,
quality management• Protocols (Corba, SOAP), Workflow standards, Data
management– Sources: To be defined

2002/11/29(c) Choi, Key-Sun62

WG 1-2
Descriptors and Mechanisms for Language Resources

Task Description and ScopePeter Wittenburg, Daan Broeder

Focus• Overview about existing projects/initiatives
and monitor its usage• Linkage with activities of the emerging
Semantic Web

2002/11/29(c) Choi, Key-Sun

64

What to do for WG1-2• Determine the– Scope of language resources– Needs of the community– Existing initiatives relevant to the language resource domain• Develop a scenario how metadata will be used in the
Semantic Web• Determine the set of descriptors and their vocabularies
useful to describe language resources• Define– All relevant terminological units (concepts and terms in major
languages) and their relations– Suitable frameworks for the definitions

2002/11/29(c) Choi, Key-Sun

65

Requirements for manageabledomain of language resources• Unique identifier for all resources– conforming to the web standards (URI)• Metadata descriptions to facilitate management– Major characteristics for large spectrum of different types of language
resources– Virtual management domains:• Accessible metadata to prohibited due to commercial, ethical or legal
reasons– Interoperability mechanisms• Syntax, semantics (data categories, vocabularies, relations)• Description level for Human + program readability• Complete workflow cycle for “management”– Process of resource creation, enhancement, integration, discovery,
exploitation, archiving and deletion• Web and multilinguality
2002/11/29(c) Choi, Key-Sun66

Scope of language resources• Electronically available resources• Written, spoken and non-verbal (gesture, sign,
facial expression and other modalities)• Examples– Websites which contain language– Publications (books)– Recordings of sign language– Lexica– Multimedia recordings or multimedia extensions– Mono- and multilingual

2002/11/29(c) Choi, Key-Sun

67

View on language resources• Examples of language resources– Technical documents of cars
– Material part of learning objects– Annotated film movies• Completely different communities: e.g.,– Technical documentation engineers• Descriptors to easily retrieve a relevant document– Linguist• For research perspective, other type of descriptors• Description of content

2002/11/29(c) Choi, Key-Sun

68

Different sets of document
management• Differences– Dublin Core– CEI/IEC 82045-1• Scope restriction in SC4/WG1-2– “Language Resources” to the study of language– Metadata descriptions describing language resources• are not meant to be language resources themselves in the context
of this note.
• Solely used for resource management and discovery purpose• Does not exclude that they will be viewed as LRs within the context
of other work.

2002/11/29(c) Choi, Key-Sun

69

LR Community• Usage scenarios for LR– General public – general information on many
subjects– Resource traders, researchers or language
engineers• Selling LR, deriving new grammar, calculating theparameters of statistical recognition algorithms

2002/11/29(c) Choi, Key-Sun70

Levels of abstraction: LR
community 2 level includes manynddifferent groups;
Usage profile is not at all
clear at this moment.

resource manager

teacherlibrariantradergeneral publicjournalist
developer

level of detailneeded for
management/
discovery

student

researcher
2002/11/29(c) Choi, Key-Sun

71

Strongly related metadata
initiatives• Media and film community: MPEG7– Started by looking at existing standards such as
SMPTE and the emerging requirements of thecommunity.
– Exhaustive element set combining• Suggestion for annotating film productions• Creating metadata descriptions• Focus in film industry– To support the production process• Annotate movies with low-level features such as “scenechange”

2002/11/29(c) Choi, Key-Sun

72

Strongly related metadata
initiatives: MPEG7• MPEG7 intention– In the object oriented MPEG4 decoding scenario– To support the query, selection and filtering processof the user
• Easily to assemble clips and other information• To new personalized presentations.

• MPEG7 Description Definition Language– To define Descriptors and Description Schemes thatis based on XML.
– Many descriptors and description schemes – alreadybeen defined including a “linguistic” one defining how
linguistic phenomena can be encoded

2002/11/29(c) Choi, Key-Sun

73

Strongly related metadata
initiatives: MPEG7 -- DC• Harmony project– Very restrictive mapping of MPEG7 metadata
elements to Dublin Core specifically to not extend thesemantics of DCMES• MPEG7 is not particularly designed for the view
on multimedia language resources people fromthe linguistic community have, but MPEG7 will
have strong impacts

2002/11/29(c) Choi, Key-Sun

74

Strongly related metadata
initiatives: IEEE - LOM• LOM (Learning Object Metadata)– Start from DCMI
– Propose an exhaustive set of elements• For the sufficient description of learning objects– … structure• specifies the set of elements together– With constraints for» Order, value range, basic data type• groups the elements into categories– To include aggregate and simple elements• Similar to IMDI implicit structure– To define controlled vocabularies for a number of data elements.

2002/11/29(c) Choi, Key-Sun

75

Strongly related metadata
initiatives: CEI/IEC 82045-1• In the area of content management• Joint effort (JWG15) for a metadata element set fromISO TC 10 and IEC SC3B
• Proposal statement– Management data as data about the content of an electronic or
paper document, necessary to manage it in an Electronic
Document Management System• Broad analysis of possible documents and document
collections including their various types of relationships
during their life-time, an exhaustive metadata set isdeveloped.
• Many elements are grouped together in a hierarchy for
intelligibility reasons.

2002/11/29(c) Choi, Key-Sun

76

Construction of WI-2: Relevant
initiatives• TEI: as initiative having worked extensively indefining structures of textual resources• DC: as most important metadata initiative
world-wide with a claim for general coverageand interoperability• OLAC: as the DC-based initiative in the domainof language resources• IMDI: as the initiative in the domain of
language resources covering more detailed
descriptions• MPEG7: as a highly relevant initiative in aclosely related domain
2002/11/29(c) Choi, Key-Sun

77

Construction of WI-2: Relevant
initiatives• IMS/LOM: also as a highly relevant initiative in aclosely related domain• IEC 82045-1: also as a highly relevant initiativein a closely related domain• COLLATE: as an initiative gathering much datain the domain of language resources almost
ready to define formal metadata sets
• Terminology Initiatives: as initiatives which knowmuch about the definition of data categories• RDF/W3C: as an initiative which has the experts
to show the way from metadata to the SemanticWeb
2002/11/29(c) Choi, Key-Sun

78

Experts in metadata
requirements• Corpus and field linguistics• Language engineering– Text-based work
– Multimodal work

• Artificial intelligence• Phonetics• Psycholinguistics

2002/11/29(c) Choi, Key-Sun

79

Multimodal Semantic
Representation
Harry Bunt, Laurent Romary, Kiyong Lee,
http://let.kub.nl/people/buntMeaning representation fromdifferent perspectives• Language (text and speech) interpretation• Language generation• Design of embodied agents• Interpretation of gestures and facial
expressions• Fusion and coordination of modalities• Multimodal dialogue system architecture

2002/11/29(c) Choi, Key-Sun

81

What should be represented
in multimodal semantics• Semantic and pragmatic aspects of meaning• Information in gestures, postures, facial
expressions• Nonlinguistic information in speech and text
• Metadata: time stamps, processing information,…
• Social and cultural information• Links to other information

2002/11/29(c) Choi, Key-Sun

82

Basic components and mechanisms in
multimodal semantics• Representational constructs• Mechanisms for linking and sharing• Specific representational issues, such as– Underspecification techniques– Flatness of representations• Which representation formalisms should beanalyzed for best practices, lessons learned,
common underlying ideas, special features, …

2002/11/29(c) Choi, Key-Sun

83

Relation to neighboring activities:
multimodal semantics• XML, RDF, semantic Web• Ontologies, domain modeling, usermodeling• Lexicon formats• Annotation schemes

2002/11/29(c) Choi, Key-Sun

84

Background organization for
WG2• http://www.sigsem.org/• http://cwis.kub.nl/~fdl/research/ti/sigsem/iwcs/iwcs5

2002/11/29(c) Choi, Key-Sun85

ISO/TC 37/SC 4/WG1-1
Language Resource Management

Linguistic Annotation Framework
21-23/Nov/2003
Pont-à-Mousson, France

<!-- Morphosyntactic level --><struct type= “W-level”<seg target = “#w3”><feat type=“lemma”>de</feat><feat type=“pos”>PREP</feat></struct><W-level xsi:type=“struct” xlink:href=“#w3”><lemma xsi:type=“Feat”>de</lemma><pos xsi:type=“Feat”>PREP</pos></W-level>
2002/11/29(c) Choi, Key-Sun

87

Revised -<struct iso-sc4:type= “W-level”<seg xlink:href = “#w3”><feat type=“lemma”>de</feat><feat type=“pos”>PREP</feat></struct><W-level xlink:href=“#w3”><lemma>de</lemma><pos>PREP</pos></W-level>
2002/11/29(c) Choi, Key-Sun

88

General scheme: (Nancy Ide)
• Expressive adequacy– Represent all varieties of linguistic information– Media independent– Rely on existing or developing standards for multi-media• Semantic adequacy– Representation structures must have a formal semantics– Centralized way of sharing descriptors and information categories– Definitions of operations• Incrementality– Support for various stages of input interpretation and output generation– Representation of partial/under-specified results and ambiguities,
alternatives, etc. (Support for under-specification)• Uniformity– Representations utilize same “building blocks” and the same methods
for combining them

• Openness– Not dependent on a single linguistic theory• Extensibility– Compatible with alternative methods for designing representation
schemas• Human readability
2002/11/29(c) Choi, Key-Sun

89

Principle of general scheme (discarded)• Expressiveness: multi-media coverage– Don’t reinvent existing or developing
standards• (e.g., MPEG7)– Media-independence

2002/11/29(c) Choi, Key-Sun

90

Relation between document design
Not intended
and data model
for archive
Accompanied
By mapping toData model
User
Annotation
form

Pivot format
Mapping spec
(e.g., W3C
XML schema)

Dump format(some instantiation
Of data model)

Meta-stylesheet

stylesheet
MACHINE
HUMAN
Or the functional equivalent thereof
2002/11/29(c) Choi, Key-Sun91