Confidential Review Copy. DO NOT DISTRIBUTE.

000

Instructions for CoNLL 2019 Proceedings

001

050
051

002

052

003

053
054

004

Anonymous CoNLL submission

005

055

006

056

007

057

008

058

009

059

010

060

011

Abstract

012
013

015
016
017
018
019
020
021

023
024
025
026
027
028
029
030
031
032
033
034
035
036
037
038
039
040
041
042
043
044
045
046
047
048
049

1

Introduction

The following instructions are directed to authorsof papers submitted to CoNLL 2019 or acceptedfor publication in its proceedings. All authors are
required to adhere to these specifications. Authors
are required to provide a Portable Document Format (PDF) version of their papers. The proceedings are designed for printing on A4 paper.

This document contains the instructions for
preparing a camera-ready manuscript for theproceedings of CoNLL 2019. The document
itself conforms to its own specifications, and istherefore an example of what your manuscript
should look like. These instructions should be
used for both papers submitted for review andfor final versions of accepted papers. Authors
are asked to conform to all the directions reported in this document.

014

022

2

3

General Instructions

Manuscripts must be in two-column format. Exceptions to the two-column format include the title, authors’ names and complete addresses, whichmust be centered at the top of the first page, andany full-width figures or tables (see the guidelines
in Subsection 3.6). Type single-spaced. Start
all pages directly under the top margin. See theguidelines later regarding formatting the first page.
The manuscript should be printed single-sided andits length should not exceed the maximum page
limit described in Section 5. Pages are numberedfor initial submission. However, do not number
the pages in the camera-ready version.
By uncommenting \aclfinalcopy at the top of
this document, it will compile to produce an example of the camera-ready formatting; by leaving it
commented out, the document will be anonymized
for initial submission.
The review process is double-blind, so do notinclude any author information (names, addresses)
when submitting a paper for review. However, you
should maintain space for names and addresses sothat they will fit in the final (accepted) version.
The CoNLL 2019 LATEX style will create a titlebox space of 2.5in for you when \aclfinalcopy
is commented out.
The author list for submissions should include
all (and only) individuals who made substantial
contributions to the work presented. Each author

Credits

This document has been adapted from the
instructions for earlier ACL, EMNLP, andNAACL proceedings. It represents a recent buildfromhttps://github.com/acl-org/
acl-pub, with modifications by Miikka Silfverberg and Sebastian Ruder, based on the
EMNLP 2019 instructions by Fei Liu and Pontus
Stenetorp, EMNLP 2018 instructions by Micha
Elsner and Preethi Raghavan, NAACL 2018
instructions by Margaret Michell and Stephanie
Lukin, 2017/2018 (NA)ACL bibtex suggestions
from Jason Eisner, ACL 2017 by Dan Gildea
and Min-Yen Kan, NAACL 2017 by Margaret
Mitchell, ACL 2012 by Maggie Li and Michael
White, those from ACL 2010 by Jing-Shing
Chang and Philipp Koehn, those for ACL 2008 by
Johanna D. Moore, Simone Teufel, James Allan,
and Sadaoki Furui, those for ACL 2005 by Hwee
Tou Ng and Kemal Oflazer, those for ACL 2002
by Eugene Charniak and Dekang Lin, and earlier
ACL and EACL formats. Those versions were
written by several people, including John Chen,Henry S. Thompson and Donald Walker. Additional elements were taken from the formatting
instructions of the International Joint Conferenceon Artificial Intelligence and the Conference on
Computer Vision and Pattern Recognition.

1

061
062
063
064
065
066
067
068
069
070
071
072
073
074
075
076
077
078
079
080
081
082
083
084
085
086
087
088
089
090
091
092
093
094
095
096
097
098
099

Confidential Review Copy. DO NOT DISTRIBUTE.

100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144

listed on a submission to CoNLL 2019 will be notified of submissions, revisions and the final decision. No authors may be added to or removed from
submissions to CoNLL 2019 after the submission
deadline.
3.1

using the pdflatex command. If your version of
LATEX produces Postscript files, you can convert
these into PDF using ps2pdf or dvipdf. On Windows, you can also use Adobe Distiller to generate
PDF.
Please make sure that your PDF file includes
all the necessary fonts (especially tree diagrams,
symbols, and fonts with Asian characters). Whenyou print or create the PDF file, there is usuallyan option in your printer setup to include none,
all or just non-standard fonts. Please make surethat you select the option of including ALL thefonts. Before sending it, test your PDF by printing it from a computer different from the one
where it was created. Moreover, some word processors may generate very large PDF files, where
each page is rendered as an image. Such images
may reproduce poorly. In this case, try alternative
ways to obtain the PDF. One way on some systems
is to install a driver for a postscript printer, send
your document to the printer specifying “Output
to a file”, then convert the file to PDF.
It is of utmost importance to specify the A4 format (21 cm x 29.7 cm) when formatting the paper.
When working with dvips, for instance, one
should specify -t a4. Or using the command\special{papersize=210mm,297mm}
in the latex preamble (directly below the\usepackage commands).
Then using
dvipdf and/or pdflatex which would makeit easier for some.
Print-outs of the PDF file on A4 paper should
be identical to the hardcopy version. If you cannot
meet the above requirements about the productionof your electronic submission, please contact the
publication chairs as soon as possible.

The Ruler

The CoNLL 2019 style defines a printed ruler
which should be presented in the version submitted for review. The ruler is provided in order that
reviewers may comment on particular lines in thepaper without circumlocution. If you are preparing a document without the provided style files,
please arrange for an equivalent ruler to appear on
the final output pages. The presence or absenceof the ruler should not change the appearance of
any other content on the page. The camera readycopy should not contain a ruler. (LATEX users may
uncomment the \aclfinalcopy command in the
document preamble.)
Reviewers: note that the ruler measurements
do not align well with lines in the paper – thisturns out to be very difficult to do well when thepaper contains many figures and equations, and,
when done, looks ugly. In most cases one would
expect that the approximate location will be adequate, although you can also use fractional references (e.g., the first paragraph on this page ends at
mark 108.5).
3.2

Electronically-available resources

SIGNLLprovidesthis
description
in
LATEX2e (conll-2019.tex) and PDF format(conll-2019.pdf), along with the LATEX2e style
file used to format it (conll-2019.sty) and an
ACL bibliography style (acl natbib.bst) andexamplebibliography(conll-2019.bib).
These files are all available at http:3.4//conll.org/downloads/conll-2019-latex.

Format manuscripts two columns to a page, in thezip;
a Microsoft Word template filemanner these instructions are formatted. The exact(http://conll.org/downloads/conll-2019-word.zip)
dimensions
for a page on A4 paper are:andexamplesubmission
pdf(conll-2019-word.pdf) is available at http://• Left and right margins: 2.5 cm
conll.org/downloads/conll-2019-word.zip.
• Top margin: 2.5 cm
We strongly recommend the use of these style
files, which have been appropriately tailored for• Bottom margin: 2.5 cm
the CoNLL 2019 proceedings.

145
146
147
148
149

LayoutFormat of Electronic Manuscript• Column width: 7.7 cm

For the production of the electronic manuscript
you must use Adobe’s Portable Document Format(PDF). PDF files are usually produced from LATEX• Column height: 24.7 cm

3.3

150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198

• Gap between columns: 0.6 cm

2199

Confidential Review Copy. DO NOT DISTRIBUTE.

Type of Text
paper title
author names
author affiliation
the word “Abstract”
section titles
document text
captions
abstract text
bibliographyfootnotes

200
201
202
203
204
205
206
207
208
209
210

Font Size
15 pt
12 pt
12 pt
12 pt
12 pt
11 pt
10 pt
10 pt
10 pt
9 pt

Command
{\"a}
{\ˆe}
{\‘i}
{\.I}
{\o}
{\’u}
{\aa}

Style
bold
bold
bold
bold

215
216
217
218
219
220
221
222
223

Papers should not be submitted on any other paper
size. If you cannot meet the above requirements
about the production of your electronic submission, please contact the publication chairs above
as soon as possible.
Fonts

For reasons of uniformity, Adobe’s Times Roman
font should be used. In LATEX2e this is accomplished by putting

224\usepackage{times}\usepackage{latexsym}

225
226
227
228
229
230
231

in the preamble. If Times Roman is unavailable,
use Computer Modern Roman (LATEX2e’s default). Note that the latter is about 10% less dense
than Adobe’s Times Roman font.
3.6

The First Page

232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249

250
251
252
253
254
255
256
257
258
259

Table 1: Font guide.

3.5

Output
ç
ğ
ł
ñ
ő
ř
ß

well except for proper names (such as “BLEU”)
that are conventionally in all capitals. The affiliation should contain the author’s complete address,
and if possible, an electronic mail address. Start
the body of the first page 7.5 cm from the top of
the page.
The title, author names and addresses should
be completely identical to those entered to theelectronical paper submission website in order tomaintain the consistency of author information
among all publications of the conference. If they
are different, the publication chairs may resolve
the difference without consulting with you; so it isin your own interest to double-check that the information is consistent.
Abstract: Type the abstract at the beginning of
the first column. The width of the abstract text
should be smaller than the width of the columns
for the text in the body of the paper by about 0.6
cm on each side. Center the word Abstract in a 12
point bold font above the body of the abstract. The
abstract should be a concise summary of the general thesis and conclusions of the paper. It should
be no longer than 200 words. The abstract text
should be in 10 point font.
Text: Begin typing the main body of the text
immediately after the abstract, observing the twocolumn format as shown in the present document.
Do not include page numbers.
Indent: Indent when starting a new paragraph,about 0.4 cm. Use 11 points for text and subsection headings, 12 points for section headings and
15 points for the title.

213
214

Command{\c c}{\u g}{\l}{\˜n}{\H o}{\v r}{\ss}

Table 2: Example commands for accented characters,
to be used in, e.g., BIBTEX names.

211
212

Output
ä
ê
ı̀
İ
ø
ú
å

Center the title, author’s name(s) and affiliation(s)across both columns. Do not use footnotes for affiliations. Do not include the paper ID number
assigned during the submission process. Use thetwo-column format only when you begin the abstract.
Title: Place the title centered at the top of thefirst page, in a 15-point bold font. (For a complete guide to font sizes and styles, see Table 1)
Long titles should be typed on two lines withouta blank line intervening. Approximately, put thetitle at 2.5 cm from the top of the page, followed
by a blank line, then the author’s names(s), andthe affiliation on the following line. Do not use
only initials for given names (middle initials areallowed). Do not format surnames in all capitals(e.g., use “Mitchell” not “MITCHELL”). Do notformat title and section headings in all capitals as

260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291

3.7

Sections

Headings: Type and label section and subsection
headings in the style shown on the present document. Use numbered sections (Arabic numerals)
in order to facilitate cross references. Number subsections with the section number and the subsection number separated by a dot, in Arabic numerals. Do not number subsubsections.

3

292
293
294
295
296
297
298
299

Confidential Review Copy. DO NOT DISTRIBUTE.

output(Gusfield, 1997)
Gusfield (1997)(1997)

300
301
302
303
304
305
306

natbib\citep\citet\citeyearpar

previous SIGNLL style files\cite\newcite\shortcite

350
351
352
353

Table 3: Citation commands supported by the style file. The citation style is based on the natbib package andsupports all natbib citation commands. It also supports commands defined in previous SIGNLL style files forcompatibility.

311
312
313
314
315
316
317
318
319
320
321
322
323
324
325

Citations: Citations within the text appear inparentheses as (Gusfield, 1997) or, if the author’s name appears in the text itself, as Gusfield (1997). Using the provided LATEX style, theformer is accomplished using \cite and the latterwith \shortcite or \newcite. Collapse multiple citations as in (Gusfield, 1997; Aho and Ullman, 1972); this is accomplished with the provided style using commas within the \cite command, e.g., \cite{Gusfield:97,Aho:72}. Append lowercase letters to the year in cases of ambiguities. Treat double authors as in (Aho and Ullman, 1972), but write as in (Chandra et al., 1981)
when more than two authors are involved. Collapse multiple citations as in (Gusfield, 1997; Ahoand Ullman, 1972). Also refrain from using fullcitations as sentence constituents.
We suggest that instead of

Anthology Identifier) to all cited works. Thus,
please ensure that you use References that contain DOI or URLs for any of the ACL materials
that you reference. Appropriate records should befound for most materials in the current ACL Anthology at http://aclanthology.info/.
As examples, we cite (Goodman et al., 2016) toshow you how papers with a DOI will appear in
the bibliography. We cite (Harper, 2014) to show
how papers without a DOI but with an ACL Anthology Identifier will appear in the bibliography.
Anonymity: As reviewing will be doubleblind, the submitted version of the papers should
not include the authors’ names and affiliations.
Furthermore, self-references that reveal the author’s identity, e.g.,

328

333
334
335
336
337
338
339

342
343
344
345
346
347
348
349

360
361
362
363
364
365
366
367
368
369
370
371
372
373

375
376
377
378

you use“Gusfield (1997) previously showed ... ”“Gusfield (1997) showed that ...”

379
380

Preprint servers such as arXiv.org and workshops that do not have published proceedings are
not considered archival for purposes of submission. However, to preserve the spirit of blind
review, authors are encouraged to refrain fromposting until the completion of the review process. Otherwise, authors must state in the online submission form the name of the workshop
or preprint server and title of the non-archival
version. The submitted version should be suitably anonymized and not contain references to theprior non-archival version. Reviewers will be told:“The author(s) have notified us that there exists a
non-archival previous version of this paper withsignificantly overlapping text. We have approved
submission under these circumstances, but to preserve the spirit of blind review, the current submission does not reference the non-archival version.”
Please do not use anonymous citations and do
not include when submitting your papers. Papers

If you are using the provided LATEX and BibTEX
style files, you can use the command \citet(cite in text) to get “author (year)” citations.
If the BibTEX file contains DOI fields, thepaper title in the references section will appear asa hyperlink to the DOI, using the hyperref LATEX
package. To disable the hyperref package, load
the style file with the nohyperref option:\usepackage[nohyperref]{conll-2019}

340
341

(Gusfield,

should be avoided. Instead, use citations such as

331
332

showed“(Gusfield, 1997) showed that ...”

329
330

359

374

“We previously1997) ...”

326
327

356

358

308

310

355

357

307

309

354

Digital Object Identifiers: As part of our work
to make ACL materials more widely used andcited outside of our discipline, ACL has registeredas a CrossRef member, as a registrant of Digital Object Identifiers (DOIs), the standard for registering permanent URNs for referencing scholarly materials. As of 2017, we are requiring allcamera-ready references to contain the appropriate
DOIs (or as a second resort, the hyperlinked ACL

4

381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399

Confidential Review Copy. DO NOT DISTRIBUTE.

400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423

3.8

that do not conform to these requirements may berejected without review.
References: Gather the full set of references together under the heading References; place thesection before any Appendices, unless they contain references. Arrange the references alphabetically by first author, rather than by order of occurrence in the text. By using a .bib file, as inthis template, this will be automatically handled
for you. See the \bibliography commands
near the end for more.
Provide as complete a citation as possible, using
a consistent format, such as the one for Computational Linguistics or the one in the Publication
Manual of the American Psychological Association (American Psychological Association, 1983).
Use of full names for authors rather than initials
is preferred. A list of abbreviations for common computer science journals can be found in
the ACM Computing Reviews (for Computing Machinery, 1983).
The LATEX and BibTEX style files provided
roughly fit the American Psychological Association format, allowing regular citations, short citations and multiple citations as described above.

URLs can be typeset using the \url command.
However, very long URLs cause a known issue inwhich the URL highlighting may incorrectly crosspages or columns in the document. Please checkcarefully for URLs too long to appear in the column, which we recommend you break, shorten
or place in footnotes. Be aware that actual URL
should appear in the text in human-readable format; neither internal nor external hyperlinks willappear in the proceedings.
3.9

426

• Example citing an arxiv paper: (Rasooli andTetreault, 2015).

427
428
429

Footnotes• Example article in journal citation: (Andoand Zhang, 2005).

432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449

451
452
453
454
455
456
457
458
459
460
461
462
463

3.10

467

Graphics

464
465
466

468
469
470
471
472
473
474
475
476
477
478
479
480

430
431

450

Footnotes: Put footnotes at the bottom of the pageand use 9 point font. They may be numbered or referred to by asterisks or other symbols.1 Footnotes
should be separated from the text by a line.2

Illustrations: Place figures, tables, and photographs in the paper near where they are first discussed, rather than at the end, if possible. Wideillustrations may run across both columns. Color
illustrations are discouraged, unless you have verified that they will be understandable when printed
in black ink.
Captions: Provide a caption for every illustration; number each one sequentially in the form:“Figure 1. Caption of the Figure.” “Table 1. Caption of the Table.” Type the captions of the figures
and tables below the body, using 11 point text.

424
425

URLs

• Example article in proceedings, with location: (Borschinger and Johnson, 2011).

3.11

Accessibility

In an effort to accommodate people who are colorblind (as well as those printing to paper), grayscalereadability for all accepted papers will be encouraged. Color is not forbidden, but authors should
ensure that tables and figures do not rely solely oncolor to convey critical distinctions. A simple criterion: All curves and points in your figures should
be clearly distinguishable without color.

• Example article in proceedings, without location: (Andrew and Gao, 2007).
See corresponding .bib file for further details.
Submissions should accurately reference priorand related work, including code and data. If apiece of prior work appeared in multiple venues,
the version that appeared in a refereed, archival
venue should be referenced. If multiple versionsof a piece of prior work exist, the one used by theauthors should be referenced. Authors should not
rely on automated citation indices to provide accurate references for prior and related work.
Appendices: Appendices, if any, directly follow the text and the references (but see above).
Letter them in sequence and provide an informative title: Appendix A. Title of Appendix.

4

Translation of non-English Terms

It is also advised to supplement non-English characters and terms with appropriate transliterations
and/or translations since not all readers understandall such characters and terms. Inline transliteration
or translation can be represented in the order of:original-form transliteration “translation”.
1
2

5This is how a footnote should appear.
Note the line separating the footnotes from the text.

481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499

Confidential Review Copy. DO NOT DISTRIBUTE.

500

5Length of Submission

501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526

The CoNLL 2019 main conference accepts submissions of long papers only. Long papers may
consist of up to eight (8) pages of content plus unlimited pages for references. Upon acceptance, final versions of long papers will be given one additional page – up to nine (9) pages of content plus
unlimited pages for references – so that reviewers’comments can be taken into account.
All illustrations and tables that are part of themain text must be accommodated within thesepage limits, observing the formatting instructions
given in the present document. Supplementarymaterial in the form of appendices does not counttowards the page limit; see appendix A for further
information.
However, note that supplementary material
should be supplementary (rather than central) tothe paper, and that reviewers may ignore supplementary material when reviewing the paper (seeAppendix A). Papers that do not conform to thespecified length and formatting requirements are
subject to be rejected without review.
Workshop chairs may have different rules for allowed length and whether supplemental material iswelcome. As always, the respective call for papers
is the authoritative source.

529
530
531
532

Acknowledgments
The acknowledgments should go immediately
before the references. Do not number the acknowledgments section. Do not include thissection when submitting your paper for review.

533
534

Include

your

own

bib

file

like

this:

537

\bibliographystyle{acl_natbib}

538\bibliography{conll-2019}

539

Where conll-2019 corresponds to theconll-2019.bib file.

540

542

544
545
546
547
548
549

554

References
Alfred V. Aho and Jeffrey D. Ullman. 1972. The
Theory of Parsing, Translation and Compiling, volume 1. Prentice-Hall, Englewood Cliffs, NJ.
American Psychological Association. 1983. Publications Manual. American Psychological Association,
Washington, DC.

6

551
552
553

555
556
557
558
559
560
561

Ashok K. Chandra, Dexter C. Kozen, and Larry J.
Stockmeyer. 1981. Alternation. Journal of the Association for Computing Machinery, 28(1):114–133.

562

Association for Computing Machinery. 1983. Computing Reviews, 24(11):503–512.

565

James Goodman, Andreas Vlachos, and Jason Naradowsky. 2016. Noise reduction and targeted exploration in imitation learning for abstract meaning representation parsing. In Proceedings of the 54th Annual Meeting of the Association for Computational
Linguistics (Volume 1: Long Papers), pages 1–11.
Association for Computational Linguistics.

567

Dan Gusfield. 1997. Algorithms on Strings, Trees
and Sequences. Cambridge University Press, Cambridge, UK.

573

Mary Harper. 2014. Learning from 26 languages: Program management and science in the babel program.
In Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics:
Technical Papers, page 1. Dublin City University
and Association for Computational Linguistics.

576

Mohammad Sadegh Rasooli and Joel R. Tetreault.
2015. Yara parser: A fast and accurate dependency parser. Computing Research Repository,
arXiv:1503.06733. Version 2.

581

A

585

Supplemental Material

Each CoNLL 2019 submission can be accompanied by a single PDF appendix, one .tgz or .zip
appendix containing software, and one .tgz or.zip appendix containing data.
Submissions may include resources (software
and/or data) used in in the work and describedin the paper. Papers that are submitted with accompanying software and/or data may receive additional credit toward the overall evaluation score,
and the potential impact of the software and data
will be taken into account when making the acceptance/rejection decisions. Any accompanying
software and/or data should include licenses anddocumentation of research review as appropriate.

541

543

Galen Andrew and Jianfeng Gao. 2007. Scalable training of L1-regularized log-linear models. In Proceedings of the 24th International Conference on
Machine Learning, pages 33–40.

Preparing References:

535
536

550

Benjamin Borschinger and Mark Johnson. 2011. A
particle filter algorithm for Bayesian wordsegmentation. In Proceedings of the Australasian Language
Technology Association Workshop 2011, pages 10–
18, Canberra, Australia.

527
528

Rie Kubota Ando and Tong Zhang. 2005. A framework
for learning predictive structures from multiple tasks
and unlabeled data. Journal of Machine Learning
Research, 6:1817–1853.

563
564

566

568
569
570
571
572

574
575

577
578
579
580

582
583
584

586
587
588
589
590
591
592
593
594
595
596
597
598
599

Confidential Review Copy. DO NOT DISTRIBUTE.

600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632

650

CoNLL 2019 also encourages the submissionof supplementary material to report preprocessing decisions, model parameters, and other details
necessary for the replication of the experiments reported in the paper. Seemingly small preprocessing decisions can sometimes make a large difference in performance, so it is crucial to record suchdecisions to precisely characterize state-of-the-art
methods.
Nonetheless, supplementary material should be
supplementary (rather than central) to the paper. Submissions that misuse the supplementary material may be rejected without review.
Essentially, supplementary material may include
explanations or details of proofs or derivations that
do not fit into the paper, lists of features or featuretemplates, sample inputs and outputs for a system,
pseudo-code or source code, and data. (Sourcecode and data should be separate uploads, rather
than part of the paper).
The paper should not rely on the supplementarymaterial: while the paper may refer to and cite
the supplementary material and the supplementarymaterial will be available to the reviewers, they
will not be asked to review the supplementary material.
Appendices (i.e. supplementary material in theform of proofs, tables, or pseudo-code) should be
uploaded as supplementary material when submitting the paper for review. Upon acceptance,
the appendices come after the references, as shown
here. Use \appendix before any appendix section to switch the section numbering over to letters.

651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682

633

683

634

684

635

685

636

686

637

687

638

688

639

689

640

690

641

691

642

692

643

693

644

694

645

695

646

696

647

697

648

698

649

699

7