.

Annotation Guidelines for Named Entities
Version 1.1

Emi MAEKAWA
2018/06/12

1. About Our Tag Set
The tag set used here combines the 18 categories described in "OntoNotes Release 5.0" [1] and 4 newly added
categories. The 18 OntoNote tags have been defined based on the tag definitions given in "OntoNotes Named
Entity Guidelines Version 14.0" [2]. The 18 tags have been slightly modified for our purpose.

2. Tag Set
Tag Name

Brief(OntoNote Tag)

Description

Comments

Example*Named entity mentions aremarked within round brackets.

NE-PERPerson

Proper names of people including first(Ray Parker Jr.)(PERSON)

Namenames, last names, individual or familyDr. (Brown) / (St. Marks)

names, fictional names and unique(Queen Elizabeth II)

nicknames. Generational markers such as(Princess Diana)

Jr. and IV, and royal titles such as Queen(Charlie Brown)

and Sir are included.

the President (Kennedy)

Unmarked: honorific titles other than theabove such as Mr., Mrs., Miss, Ms, and Dr.

NE-PER-N

Post /Names of posts and job titles.

(American President) Bush(newly added)

Job TitleUnmarked: honorific titles such as Mr. and(Microsoft CEO)Dr., modifiers such as "former" andformer (First Lady)"previous", and any common nouns.

(Judge) Brown

NE-CHA

Non-human

Names of creatures other than humans(Snoopy)(newly added)

Creature

including animals and fictional non-human(Flipper) the dolphin

Namecharacters. Names of gods andgoddesses are marked with NE-PER,NOT NE-CHA.

NE-NRP

Nationality /Adjectival forms of GPE and non-GPE(European) euphoria(NORP)

Religion /place names (such as American), namedan (American) publishing group

Politicalreligions, heritage, and political affiliation.

He is (Jewish).

affiliation

Regardless of context, adjectival forms

The (Hindu) newspaper

such as "French" are NRPs while nominal

Three (Democrats)

forms such as "France" are GPEs.

the (Muslims)
France's (Socialist) government

NE-FAC

Facility

Names of man-made structures, including

the (Brooklyn Bridge)

(FACILITY)

Namebuildings, airports, stations, infrastructures(Yankee Stadium)(bridges and streets), monuments, oil(Madison Avenue)

fields, golf courses, hospitals, zoos,(42nd Street) / the (Eiffel Tower)shopping centers, etc. Facility names can(Statue of Liberty)

be ORG depending on context.

We got out of the (City Library).
(NE-ORG City Library) said that

NE-ADD

Contact

Addresses, phone numbers, URLs, email(newly added)

Information

addresses. The expression "[place name],(10025 5th Ave., NY, NY 10003)[higher-level municipality's name]" such asc.f.

"Boston, MA" and "Paris, France" is NOTon (NE-FAC 5th Ave), (NE-GPE

marked with NE-ADD.

NY).

NE-ORG

Organization

Names of companies, government(IBM) / (Capitol Hill)(ORGANIZA-Nameagencies, political parties, educational(White House)

institutions, sport teams, hospitals,(Democratic Party)

museums, libraries etc. Government and(Hilton Hotel)

political facilities such as White House andA (Democratic) candidate

Pentagon are marked with NE-ORG.

(New York Stock Exchange)

Organization names can be NE-FAC(LIFE) / The (New York Times)

depending on context. Especially, hotels,a (Boston) shortstop

museums, hospitals, libraries, churches(YouTube) / a (Wikipedia) article

and temples, commercial facilities, stockthe (Japanese Government)

exchanges, etc. are often marked withthe (Japanese government)

NE-FAC. Adjectival forms of organization(Obama administration)

TION)

names are also marked with NE-ORG.
Names of newspapers, magazines, andc.f. outside the (NE-FAC NYSE)

websites are always marked with NE-ORG
regardless of whether they refer to theartifact or the organization. City names
referring to a sport team are marked with
NE-ORG while country names are always
marked with NE-GPE.

NE-GPECountry /Names of geographical administrativea (US) company / (Paris)(GPE)

Municipality

entities including countries, villages, cities,

southern (California)

Namestates, provinces, prefectures, and otherthe (United Kingdom)

forms of municipalities. Island names arealso marked with NE-GPE if they areadministrative units. When you do notknow whether a geographical entity is anadministrative unit or not, mark it withNE-GPE.

NE-LOC

Non-GPE

Names of locations other than GPEs

the (Hudson River) / (Europe)(LOCATION)

Locationincluding celestial bodies, stars,(Brighton Beach)Namecontinents, mountains, oceans, coasts,(Long Island) / (Latin America)

rivers, lakes, borders, etc. Named regions,(Silicon Valley)

areas, and neighborhood such as "Middle(Earth) / the (Sun)East", "Europe", and "East Village" are(Greenwich Village)

included in this category.

NE-PROProductName of any product including((NE-ORG Ford) (NE-PRO Taurus))(PRODUCT)

Name

non-commercial vehicles (automobiles,

Two (NE-PRO Fords)

rockets, aircraft, ships). Although(Space Shuttle Discovery)references including manufacturer and(Lotto 6)

product names are marked as two
different entities, products using only their
manufacturer’s name (as in “I bought aFord”) are marked with NE-PRO.
Unlike the OntoNotes definition, financial
products and services are also included inthis category.

NE-EVT

Event Name

Named events and phenomena including(Hurricane Hugo)

natural disasters, hurricanes, revolutions,the (Vietnam War)battles, wars, demonstrations, concerts,

the (Mexican Revolution)

sports events, etc.

the (2016 World Cup) / (F1)

Titles of books, songs, films, plays and(Gone with the Wind)(WORK OFother creations such as awards, stock(Oscar) / (Nobel Prize)ART)

price indexes, and social security systems(Academy Award for Best Actor)

including health insurance systems or

I read a (Harry Potter) book.

pension plans. Newspaper headlines are(Dow Jones Industrial Average)

marked with NE-ART only when they are

the (Union Flag)(EVENT)

NE-ART

Title

referential. Headlines used as "headlines"
should not be marked. Series names, as inthe "Harry Potter series", are also marked.

NE-PJT

Project

Names of projects, systems, ideas,

the (New Deal) project(newly added)

Namepolicies, plans, movements, doctrines,(Medicare)religions, thoughts, systems, etc. Can be
NE-ORG depending on context.

NE-LAW

Name ofNamed legal documents including laws,(Bill of Rights)

(LAW)

Law

treaties, sections, and chapters.

the (Johnson Act)the (Warsaw Pact)(Article II of the Constitution)

NE-LAN

Language(LANGUAGE)
NE-DT

Date(DATE)

Any named language includinga (Japanese) dictionary

programming languages.

written in (English)

Date or period of 24 hours or more,(Dec. 31 2001) / (Monday)

including day, week, month, certain named(several years) / (today)

period, season, year, etc. Age is also

(every year) / (last month)included in this category whether it is aMark, (aged 35), is …

noun, adjective, or adverb phrase. Definite

at (the age of 65) / (50 years old)articles should be included if they are(the previous quarter) / (Spring)needed to denote specific time. Definite(a year ago) / (1990-1995)

articles should not be included when(these days) / (the weekend)time-denoting words are premodified(23, 24, and 28 January)either by last, next or ordinal number,(the following/previous year)

while definite articles should be included

the (last/next/second year)

when premodified by other adjectives.

(the past/next/previous 3 days)

Note, however, that definite articles should(the recent months) / (the 60's)

be included when a numerical expression

the (summer months)

is inserted between a time-denoting word

the (21st century) / the (first day)and one of the premodifiers
last/next/ordinal (e.g. last five years).
Unmarked: "now", "past", "future",time-denoting adjectives and adverbs
such as "recent", "recently", and"previously".

NE-TMTime(TIME)

Times of day and time duration less than

(4 p.m.) / (this morning)

24 hours. The expression "24 hours" is(3 hours) / (the first 5 minutes)

marked with NE-DT, NOT NE-TM.

the (morning/afternoon/night)
the (second quarter)the (42nd minute) / the (first half)

NE-PC

Percentage.

(PERCENT)

Percent symbol or the word "percent"(60 %)

should be included.

NE-MO

Monetary

Monetary units must be explicitly written.

(50 yen) / ($ 1000.00)(MONEY)

Value.

Rate expressions such as "per share" in($3) per share"$5 per share" should not be included.

(3 dollars) per share

Measurements including length, distance,(about 5 miles)

area, weight, heat, velocity, temperature,the (100-m) race

NE-QT(QUANTITY)

Quantity

byte size, etc. Units of measurement must

(more than 4 acres)be explicitly written.

(60 miles an hour)(40 megabytes)

NE-OD

Ordinal(ORDINAL)

Number

NE-CD(CARDINAL)

All ordinal numbers including adverbials.

(first) / (second) / (secondly)

Cardinal

Any numerical expression not categorized(half) / (hundreds) / (one-third)

Numberin any of the above categories. Numbers(100) people / (7) goals

appearing as list item numbers or

The Yankees won (4-1).

numbers used in addresses are also

(10 times) moremarked with NE-CD. Quantificational

Unmarked: many times

modifiers such as "only" and "just" are also
included in the extent.

NE-UC(newly added)

Unclassified

Any named entity not categorized in any of(D-Calif.) / (R-NY)

the above categories.

(Billboard Hot 100 Chart)
the case (Brown vs. New York)3. Extents■Articles
Articles should not be included in the extent (exceptions: time and numerical expressions and NE-ART).
the Philippines => the (NE-GPE Philippines)
Definite articles before organizational names should not be included even when they begin with the upper-caseletter "T".
He was interviewed by The New York Times.

=> … by The (NE-ORG New York Times).

When an article is part of a title, the article should be included.
the film "The Thing" => the film "(NE-ART The Thing)"
When not including articles does not conform to the Penn Treebank's bracketing guidelines, articles are included inthe extent.
the United States of America(NP (NP the United States)(PP of(NP America)))In the phrase above, the article "the" and the noun phrase "United States" are first bracketed and therefore cannot beseparated.
=> (NE-GPE the United States of America)■Punctuations and Prepositions
Phrases separated by punctuations or prepositions should be marked as separate entities (exceptions: NE-DT,NE-TM, and names officially including punctuations or prepositions such as "United States of America").
It happened in Boston, MA. =>It happened in (NE-GPE Boston), (NE-GPE MA).

Time expressions to denote certain times or durations should not be separated into their component parts. They
should be marked in their entirety.
at two p.m. of the third day =>at (NE-TM two p.m. of the third day)Note, however, that if marking a phrase in such way does not conform to the Penn Treebank structure, the phrase
should be separated.
The accident occurred at 3 p.m. on Monday.

=> … at (NE-TM 3 p.m.) on (NE-DT Monday).

* Should not be marked as (NE-TM 3 p.m. on Monday).
Prepositions used in range expressions such as "from", "to", and "between" are included in the extent.
from the 26th to 28th of April => (NE-DT from the 26th to 28th of April)■Bracketed Phrases: Apposition
When a bracketed phrase is a named entity and apposition of the immediately preceding phrase, they should be
separately marked.
International Business Machine [IBM]=> (NE-ORG International Business Machine) [(NE-ORG IBM)]
3550 pounds [16100 kg] =>(NE-QT 3550 pounds) [(NE-QT 16100 kg)]

Even when a bracketed phrase is inserted in the middle of a named entity or numerical/temporal expression, thewhole phrase should NOT be marked as one NE.
next Sunday [November 25] morning=> (NE-DT next Sunday) [(NE-DT November 25 )] (NE-TM morning)* Wrong marking: (NE-TM next Sunday [November 25] morning)■Bracketed Phrases: Supplementary Information

When a numerical and temporal expression is followed by supplementary information withinparentheses, the bracketed part should NOT be included in the extent.
at two p.m. (UTC) => at (NE-TM two p.m.) (UTC)■Lowercase Letters
When a word(s) in a named entity happens to begin with a lowercase letter, that word(s) should also be included inthe extent.
Central Intelligence agency =>(NE-ORG Central Intelligence agency)

U.S. navy => (NE-ORG U.S. navy)
When such words are not included in the original name, they should not be included.
KGB security agency => (NE-ORG KGB) security agency
Words beginning with a lowercase letter in GPE/non-GPE location names and facility names should be included inthe extent.
the (NE-LOC Hudson river)/ (NE-FAC Waterman street)/ (NE-GPE Normandy province)

4. Newly Added Categories■NE-PER-N: Post and Job Title
Names of posts and job titles.
Basically, each word in a NE-PER-N should begin with a capital letter, but in some cases, words beginning with alowercase letter are also considered NE-PER-Ns as in some of the examples below. Honorific titles such as Mr. andDr. are not marked.
Examples (NE-PER-Ns are marked within round brackets) :ambassador to: (ambassador to France)
Baron + Person name: (Baron) Brown
Coach + Person name: (Coach) Chip Kelly
district court judge: (Western Australian district court judge)
governor: (California governor)
government attorney: (government attorney)
FA chief executive: (FA chief executive)
FIFA general secretary: (FIFA general secretary)
FIFA President: (FIFA President), (FIFA president)
Foreign minister: (Foreign minister), (foreign minister)leader: (Conservative Party leader)
Member of Parliament: (Member of Parliament)
President: (President) Bush, (US President) Bush, (US president) Bush
President of: (President of the United States), (president of the United States)
prince: (Moroccan Prince)
Professor: Professor (NE-PER Brown)
Senator: (NE-GPE Arizona) (NE-PER-N Senator)
spokesman: (White House spokesman), (Utah Department of Transportation spokesman),(Pentagon spokesman)
Lowercase lettered "spokesmen/women/persons" are marked with NE-PER-N only when they are
working for government agencies. Spokespersons working for other types of organizations should
not be marked: (ORG IBM) spokesman
White House adviser: (White House adviser)■CHA : Name of Non-human Creature
Names of creatures other than humans including animals and fictional non-human characters.

Names of gods and goddesses or names of human-like fairies are marked with NE-PER, NOT NE-CHA.

■ADD: Contact Information
Addresses, phone numbers, email addresses, URLs, etc.
Unlike OntoNote annotation, where addresses are broken down into several parts, addresses should be marked with
NE-ADD as one entity. Each element in an address should not be marked with NE-ADD when it is used singly.
23 Spring Street, New York, New York =>It is located on Spring Street.
New York is a big city.

=>(NE-ADD 23 Spring Street, New York, New York)

It is located on (NE-FAC Spring Street).

=> (NE-GPE New York) is a big city.

Combinations of a number and location name (street name) are marked with NE-ADD.
It is 23 Spring Street. => It is (NE-ADD 23 Spring Street).
When URLs are used as website names, they should be marked with NE-ORG, NOT NE-ADD.

■PJT: Project
Names of projects, plans, movements, doctrines, (new) religions, thoughts, systems, etc. Five major religion names(Buddhism, Christianity, Hinduism, Islam, and Judaism) are NOT marked.

■UC: Unclassified
Any named entity not categorized in any of the rest of the categories.

5. Problematic Cases■Head Sharing
Example: Scottish and Irish FAs
When two or more entities share the same head, the entire phrase is marked as one named entity so that thetreebank structure can be maintained, not like the OntoNotes guidelines where only the named entity that is closest
to the head word is marked.
(NE-ORG Scottish and Irish FAs)
NE-DTs and NE-TMs are also marked the same way.
June 7 and 8 =>(NE-DT June 7 and 8)

c.f. (NE-DT June 7) and (NE-DT June 8)■Named Places: NE-LOC or NE-GPE
When you do not know whether a geographical entity is an administrative unit or not, mark it with NE-GPE.

■NE-DT and NE-TM
Adverbs and adjectives to denote specific time are included, but prepositions, such as "for" in "for two days", areNOT included.
two years ago=>(NE-DT (ADVP (NP two years) ago))

a two-year-old girl =>a (NE-DT two-year-old) girl

Tom Brown, aged 32, is … => Tom Brown, (NE-DT (ADJP aged 32)), is …
in two hours => in (NE-TM two hours)*Wrong marking: (NE-TM (PP in two hours))

6. References[1] Ralph Weischedel et al. 2012, OntoNotes Release 5.0", accessed 1 June 2017,<https://catalog.ldc.upenn.edu/docs/LDC2013T19/OntoNotes-Release-5.0.pdf>[2] Raytheon BBN Technologies 2004, OntoNotes Named Entity Guidelines Version 14.0, accessed 1 July 2017,<https://docs.google.com/viewer?a=v&pid=sites&srcid=ZGVmYXVsdGRvbWFpbnxjbHRsYW5ub3RhdGlvbnN8
Z3g6MzVlOGFkMjQ4ZWMxM2Y5MA>