INTERNATIONAL ORGANIZATION FOR STANDARDIZATIONORGANISATION INTERNATIONALE DE NORMALISATION
ISO/IEC JTC 1/SC 2/WG 2
Universal Multiple-Octet Coded Character Set(UCS)
ISO/IEC JTC 1/SC 2/WG 2 N 2696
2004-01-22
Title:
Source:References:
Action:Distribution:

Presentation Foils from National Workshop on Unicode, New Delhi, Sept 24-26,
2003
V.S. Umamaheswaran – umavs@ca.ibm.com
For information to WG2ISO/IEC JTC 1/SC 2/WG 2

At the request of our convener Mr. Mike Ksar, I have packaged the set of foils (modified slightly)that I had presented at the National Workshop on Unicode, New Delhi, Sept 24-26, 2003,
organized by the Ministry of Information and Communication Technology, India. Some of you
involved with JTC1/SC2/WG2 and the Unicode Technical Committee may find it of some use.
In particular, slide number 4 of the second presentation – on page 14 – titled ‘Framework forDiscussion’ was also used in WG2 meeting M44 during our ad hoc on Tibetan. It is a gist of theprinciples to follow while proposing additions or changes to the standard.

Unicode andISO/IEC 10646
V.S. Umamaheswaran
umavs@ca.ibm.com
IBM Toronto Lab, Canada20032003-0909-25

Session 10, National Workshop on
Unicode, New Delhi

1Topics
Unicode and ISO/IEC 10646¾ UCA and 14651¾ Processes¾ Guidelines for Proposals¾ Organize the Expertise¾20032003-0909-25

Session 10, National Workshop on
Unicode, New Delhi

21

Unicode and ISO/IEC 10646
UnicodeCode Space10646
0 to x10FFFF*Repertoire

0 tox10FFFF
Same

Supp. Planes

Same

Same

BMP non CJKV SameSame

BMP CJKVCJKV Cols

Single Col

SameChart Creation Common DB Common DB
20032003-0909-25

Session 10, National Workshop on
Unicode, New Delhi

3Unicode and ISO/IEC 10646

20032003-0909-25

Session 10, National Workshop on
Unicode, New Delhi

42

Unicode and ISO/IEC 10646
Unicode10646
Web; Book Edition + Amds
Publication
Dot Release (1 volume endof 2003)
Book Style ISO Style
Levels 1, 2, 3
Conformance =Level 3(use 3 for Indic)
BiDi
DefinedRefers toUnicode
Normalization Defined
Refers toUnicode

20032003-0909-25

5

Session 10, National Workshop on
Unicode, New Delhi

Unicode and ISO/IEC 10646
UnicodeCombining

Property +TRs+ Text
Format Chars Property

10646
List + Minimal
InfoSome Listed

Script Info

Lot of Detail Minimal

Annotations

Many more Some in AnnexNaming Rules uses 10646 Defined

20032003-0909-25

Session 10, National Workshop on
Unicode, New Delhi

63

Unicode and ISO/IEC 10646
UnicodeProperties + Defined
ProcessingRules
UTF-8,-16,
Same-32/UCS4
Compressions Defined
….

…..

10646

Out of scopeSame
Not included…..

Conforming to Unicode will automaticallyconform to 10646 Level 3 plus lots more20032003-0909-25

Session 10, National Workshop on
Unicode, New Delhi

7

Unicode Collation Algorithm
and ISO/IEC 14651
Synchronized with Each Other Share same Concepts for Weights Categories andTailoring Tailoring Required in Both Default Weights and Repertoire Identical in Both– generated from the same data base 14651 Editions + Amds versus UCA Versions
Conforming to UCA will also conformto 14651 plus more functions
20032003-0909-25

Session 10, National Workshop on
Unicode, New Delhi

84

Processes

20032003-0909-25

9

Session 10, National Workshop on
Unicode, New Delhi

Processes

2 Ballots
Draft, Final
12-18 months

20032003-0909-25

Session 10, National Workshop on
Unicode, New Delhi

105

Processes¾UTC has additional procedures for
preparing and processing TechnicalReports¾See FAQ page at Unicode site20032003-0909-25

Session 10, National Workshop on
Unicode, New Delhi

11Processes
Membership in SC2• National Bodies

Ex: INCITS in USA, SCC in Canada, BIS in India
Roster on SC2 site www.dkuug.dk/JTC1/SC2

Membership in UTC• Review by all members and experts• Voting by Corporate Members
Government of India is a Corporate Member
 Roster on Unicode site.
20032003-0909-25

Session 10, National Workshop on
Unicode, New Delhi

126

Proposal Guidelines
Do your homework? Check if Already encoded ?
(see http://www.unicode.org/standard/where/)¾

Check Charts in Unicode V4¾Also charts in TRs –¾¾¾¾¾
20032003-0909-25

TR15 Normalization charts
TR10 Collation charts
TR21 Case map charts
TR24 Script charts

or for legacy sets ICU Charmaps or equivalents
Session 10, National Workshop on
Unicode, New Delhi

13Proposal Guidelines¾May be in a block with recognized name ..
¾Search Nameslist file in Unicode Database
Name could be in Annotations¾Shape in standard can be a variant(see handout page 2)¾Is it a Glyph (from a Font for example?)
http://www.unicode.org/reports/tr17/#Characters vs. Glyphs

and TR 15285 – Character Glyph Model
http://isotc.iso.ch/livelink/livelink/fetch/2000/2489/Ittf_Ho
me/PubliclyAvailableStandards.htm??Redirect=1
20032003-0909-25

Session 10, National Workshop on
Unicode, New Delhi

147

Proposal Guidelines¾Character may be under consideration¾Look in Unicode Pipeline
http://www.unicode.org/alloc/Pipeline.html¾Check if previously considered and rejected http://www.unicode.org/alloc/rejected.html¾Also for any accepted pending scripts:
http://www.unicode.org/pending/pending.html
20032003-0909-25

Session 10, National Workshop on
Unicode, New Delhi

15

Proposal Guidelines
Do your homework
For entire script - check out the ROADMAPS:
http://www.unicode.org/roadmaps
http://www.dkuug.dk/JTC1/SC2/WG2/docs/roadmaps.html
Already encoded- Bold text in Roadmap
proposal accepted- (Bold text between parentheses)
under consideration (Text between parentheses)
exploratory ¿Text between question marks?
possible future – no suggestions ???
hot links for latest proposal included
20032003-0909-25

Session 10, National Workshop on
Unicode, New Delhi

168http://www.unicode.org/roadmaps/bmp/

20032003-0909-25

Session 10, National Workshop on
Unicode, New Delhi

17

Proposal Guidelines
Do Your Homework? Can the character be represented as sequences ?
Remember no Duplicate Representation¾¾¾¾

Indic conjuncts fall into this category
Check out Chapter 9 of Unicode 4.0(Examples in handout last 3 pages)
http://www.unicode.org/standard/where/ , andhttp://www.unicode.org/faq/char_combmark.html

20032003-0909-25

Session 10, National Workshop on
Unicode, New Delhi

189Proposal Guidelines
Other proposals may exist elsewhere in draft form
especially with archaic / minority scripts
Ex: Kharoshthi, Brahmi, Surashtrian .. proposals
Ask / network on the public discussion lists
http://www.unicode.org/consortium/distlist.html
indic@unicode.org is set up for Indic
20032003-0909-25

19

Session 10, National Workshop on
Unicode, New Delhi

UseLatest

www.dkuug.dk/JTC1/SC2/WG2/principles.html
Annex A: Information Accompanying Submissions
Annex F: Formal criteria for disunification
Annex G: Formal criteria for coding precomposed characters
Annex H: Criteria for encoding symbols
20032003-0909-25

Session 10, National Workshop on
Unicode, New Delhi

2010

WHEN YOU ARE CERTAIN A NEW PROPOSALIS WARRANTED

Prepare the Proposal Summary Form
www.dkuug.dk/JTC1/SC2/WG2/summaryform.htm
20032003-0909-25

Session 10, National Workshop on
Unicode, New Delhi

21

Proposal Guidelines
Proposal Summary Form

¾ Contains several questions to be answered¾ See Submitter’s Responsibilities in Form
¾ Most related to the previous checking steps¾ Additional Information to assist in evaluation by UTC
and WG2¾ Unicode Properties, Evidence of use, References¾ Information about submitters & others consulted¾ Preferred location, Glyphs/Font for publications

Facilitates evaluation by UTC, WG2and other experts worldwide
20032003-0909-25

Session 10, National Workshop on
Unicode, New Delhi

2211

Organize the Experts
Some Observations / Suggestions
¾¾¾

¾
¾¾¾

Workshops are Educational
Formal review and Consensus Process helps in consolidated
national positions
Participation by Regulators (Governments), User
Communities and Industry – is important
Possibly rere-activate BIS working group
Be present at UTC and ISO committees with some Continuityof Participation
Maximize use of ee-discussion lists – free dialog
Continue to Prepare and disseminate Resources andEducation material

20032003-0909-25

Session 10, National Workshop on
Unicode, New Delhi

2312

Unicode Issues
Dravidian Group
Kannada, Malayalam, Tamil &Telugu

V.S. Umamaheswaran(umavs@ca.ibm.com)
IBM Toronto Lab, Canada
20032003-0909-25

Session 9, National Unicode Workshop
on Unicode, New Delhi

1

Characters added in V4.0
(in response to latest request from India)
0CBC KANNADA SIGN NUKTA
0CBD KANNADA SIGN AVAGRAHA(from TNG Keyboard Layout)
0BF30BF40BF50BF60BF70BF80BF90BFA

20032003-0909-25

TAMIL DAY SIGN (Naal)TAMIL MONTH SIGN (Maatham)
TAMIL YEAR SIGN (Varudam)
TAMIL DEBIT SIGN (Patru)
TAMIL CREDIT SIGN (Varavu)
TAMIL AS ABOVE SIGN (Merpadi)
TAMIL RUPEE SIGN (Rupai)
TAMIL NUMBER SIGN (Enn)

Session 9, National Unicode Workshop
on Unicode, New Delhi

21Additions in V4.0
Additions to text of Chapter 9 to address several of therequests in latest input from Gov of India and from otherinputs.
Some examples:andAdded text - where users are to look for the DANDADOUBLE DANDA characters (in the Devanagari block).
0CCD KANNADA SIGN VIRAMA* preferred name is halantSee handout charts and names list for Annotations added.
20032003-0909-25

Session 9, National Unicode Workshop
on Unicode, New Delhi

3

Framework for discussion¾ Respect Stability Policy¾ No removal of existing character¾ No relocation / reordering of existing code positions¾ No name changes¾ No changes to existing canonical equivalences / normalization¾ No new multiple spellings¾ No new encoding model¾ If sequences satisfy the requirement no new character needed(Ch 9)¾ Suggestions that can be entertained¾ Text for FAQ, Tech Note, Standard - for better understanding¾ Possible new sequences¾ Annotations where appropriate¾ New characters only with evidence¾ Deprecation only with strong justification
20032003-0909-25

Session 9, National Unicode Workshop
on Unicode, New Delhi

42

Packaging Results of Discussion
For each Dravidian Script Categorize issues as:¾

Proposal for FAQ material¾

Proposal for Unicode Technical Note¾

Proposal for Explanatory text

¾Proposal for Annotation¾

Proposal for Deprecation¾

Proposal for New Character

Assign an Owner for Each20032003-0909-25

Session 9, National Unicode Workshop
on Unicode, New Delhi

53