SlowGuess/ACL_2020_OCR huggingface dataset:
Bei Yu. 2012. Function words for Chinese authorship attribution. In Proceedings of the NAACL-HLT 2012 Workshop on Computational Linguistics for Literature, pages 45-53, Montreal, Canada. Association for Computational Linguistics.
Wajdi Zaghouani and Anis Charfi. 2018. Arap-tweet: A large multi-dialect twitter corpus for gender, age and language variety identification. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), Miyazaki, Japan. European Language Resources Association (ELRA).
Dong Zhang, Shoushan Li, Hongling Wang, and Guodong Zhou. 2016. User classification with multiple textual perspectives. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pages 2112-2121, Osaka, Japan. The COLING 2016 Organizing Committee.
Jieyu Zhao, Tianlu Wang, Mark Yatskar, Vicente Ordonez, and Kai-Wei Chang. 2017. Men also like shopping: Reducing gender bias amplification using corpus-level constraints. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 2979-2989, Copenhagen, Denmark. Association for Computational Linguistics.
Jieyu Zhao, Tianlu Wang, Mark Yatskar, Vicente Ordonez, and Kai-Wei Chang. 2018a. Gender bias in coreference resolution: Evaluation and debiasing methods. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), pages 15–20, New Orleans, Louisiana. Association for Computational Linguistics.
Jieyu Zhao, Yichao Zhou, Zeyu Li, Wei Wang, and Kai-Wei Chang. 2018b. Learning gender-neutral word embeddings. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 4847-4853, Brussels, Belgium. Association for Computational Linguistics.
Lal Zimman. 2019. Trans self-identification and the language of neoliberal selfhood: Agency, power, and the limits of monologic discourse. International Journal of the Sociology of Language, 2019:147-175.
Ran Zmigrod, Sebastian J. Mielke, Hanna Wallach, and Ryan Cotterell. 2019. Counterfactual data augmentation for mitigating gender stereotypes in languages with rich morphology. arXiv preprint arXiv:1906.04571.
Michael Zock, Gil Francopoulou, and Abdellatif Laroui. 1988. Language learning as problem solving. In *Coling Budapest 1988 Volume 2: International Conference on Computational Linguistics*.
A Examples of Possible Bias in Data Annotation
Bias can enter coreference resolution datasets, which we use to train our systems, through annotation phase. Annotators may use linguistic notions to infer social gender. For instance, consider (2) below, in which an annotator is likely to determine that “her” refers to “Mary” and not “John” due to assumptions on likely ways that names may map to pronouns (or possibly by not considering that SHE pronouns could refer to someone named “John”). While in (3), an annotator is likely to have difficulty making a determination because both “Sue” and “Mary” suggest “her”. In (4), an annotator lacking knowledge of name stereotypes on typical Chinese and Indian names (plus the fact that given names in Chinese — especially when romanized — generally do not signal gender strongly), respectively, will likewise have difficulty.
(2) John and Mary visited her mother.
(3) Sue and Mary visited her mother.
(4) Liang and Aditya visited her mother.
In all these cases, the plausible rough inference is that a reader takes a name, uses it to infer the social gender of the extra-linguistic referent. Later the reader sees the SHE pronoun, infers the referential gender of that pronoun, and checks to see if they match.
An equivalent inference happens not just for names, but also for lexical gender references (both gendered nouns (5) and terms of address (6)), grammatical gender references (in gender languages like Arabic (7)), and social gender references (8). The last of these ((8)) is the case in which the correct referent is likely to be least clear to most annotators, and also the case studied by Rudinger et al. (2018) and Zhao et al. (2018a).
(5) My brother and niece visited her mother.
(6) Mr. Hashimoto and Mrs. Iwu visited her mother.
(7) wJlgl uLal alaal g yBolwalidatu-ha shahidanaan walidatuha w almutarab mother -hersaw actor[FEM] and singer[MASC] The singer[MASC] and actor[FEM] saw hermother.
(8) The nurse and the actor visited her mother.
B Annotation of ACL Anthology Papers
Below we list the complete set of annotations we did of the papers described in §5.1. For each of the papers considered, we annotate the following items:
- Coref: Does the paper discuss coreference resolution?
- L.G: Does the paper deal with linguistic gender (grammatical gender or gendered pronouns)?
- S.G: Does the paper deal with social gender?
- Eng: Does the paper study English?
-  $\mathrm{L} \neq  \mathrm{G}$  : (If yes to L.G and S.G:) Does the paper distinguish linguistic from social gender?
- 0/1: (If yes to S.G:) Does the paper explicitly or implicitly assume that social gender is binary?
- Imm: (If yes to S.G:) Does the paper explicitly or implicitly assume social gender is immutable?
- Neo: (If yes to S.G and to English:) Does the paper explicitly consider uses of definite singular "they" or neopronouns?
For each of these, we mark with [Y] if the answer is yes, [N] if the answer is no, and [-] if this question is not applicable (ie it doesn't pass the conditional checks).
4591
C Example GICoref Document from Wikipedia: Dana Zzyym
[[Source: https://en.wikipedia.org/wiki/Dana_Zzyym]]
Dana Alix Zzyym is an Intersex activist and former sailor who was the first military veteran in the United States to seek a non - binary gender U.S. passport , in a lawsuit ZzyymA v . PompeoC .
ZzyymA has expressed that their A childhood as a military brat made it out of the question for them A to be associated with the queer community as a youth due to the prevalence of homophobia in the armed forces . Their A parents B hid ZzyymA 's status as intersex from them A and ZzyymA discovered their identity and the surgeries their A parents B had approved for them A by themselves B after their A Navy service . In 1978 , ZzyymA joined the Navy as a machinist 's mate .
ZzyymA has been an avid supporter of the Intersex Campaign for Equality .
Zzyym is the first veteran to seek a non - binary gender U.S. passport . In light of the State Department 's continuing refusal to recognize an appropriate gender marker , on June 27 , 2017 a federal court granted Lambda Legal 's motion to reopen the case . On September 19 , 2018 , the United States District Court for the District of Colorado enjoined the U.S. Department of State from relying upon its binary - only gender marker policy to withhold the requested passport .
D Example GICoref Document from AO3: Scar Tissue
[[Source: https://archiveofourown.org/works/14476524]]
[[Author: cornheck]]
Despite dreading their first true series of final exams, Crona's relieved to have a particularly absorbative memory, lucky to recall all the material they'd been required to catch up on. Half a semester of attendance, a whole year of course content.
The only true moment of discomfort came when they arrived at the essay portion. Thankful it was easy enough to answer, however, their subtle eye - roll stemmed entirely from just how much writing it asked of them, hands already beginning to ache at the thought of crawling out two pages on the origins, history, and importance of partnered and grouped soul resonance.
By the end of it all, theirA neck, wrist, back, and ribs ached from the strain of theirA typical, hunched posture - a habit theyA defaulted to , and Miss MarieB silently wished theyA 'd be more mindful of . It was a relief , at least to themA , not to be the last one out of the lecture hall . Booklet turned in , theyA left the room as quietly as possible and lingered just outside , an air of hesitance settling upon themA as theyA considered what to do now that , it seemed , everything was over with . No more class , no more lessons , just ... students on break from their studies for the season .
"Kind of a breeze, was n't it ? " Evans ' voice echoes in the arched hall and Crona 's shoulders jump , their frame still a tense and anxious mess .
"Oh , " they A sigh , " I A ... I A suppose so . It was n't ... necessarily hard . " CronaA answers , putting forth a vaguely forced smile .
Smiling with the assumed purpose of making Soul ℃ comfortable with the interaction . A defense mechanism .
“ [ I _ A - I _ A guess , for a final , it was easier than I _ A expected … everyone … made it sound like it 'd be difficult . ”
If by everyone, you mean Black Star, then yeah, "Soul chuckles, "he does n't really do well on 'em bad test - taker.
“ Ah , ” theirA facade falls just in time to be replaced by a much more genuine grin .
Of the little they A'd spent talking to Black Star , he certainly had confidence and skill enough to make up for the lost exam points given his performance in every other grading category .
"That ... makes sense . "
" Maka' 's always the first one done when it comes to this stuff , she 's practically studies in her sleep . 'm convinced she ' must be practicing clairvoyance the way she ' burns through essay questions , " Soul ' laughs , turning to the meek teenA who gives him ' a simple nod in response .
Determined not to let an impending awkward silence fall between them, Soul pipes up again, "So, are you staying here for break?"
"Ye - well, I_A ... I_A think so," they_A begin, stuttering, but encouraged to continue by a cock of Soul_C's head; a social cue even they_A could read, "The professor_H ... and Miss Marie_B_G asked if I_A'd like to come and stay with them_G for the time being."
"Oh , huh , SteinH and MarieBG ? Nice , " hisC brows lift , clearly some varying degree of happy for the otherA .
The optimism is short - lived, observing as  $\mathrm{Crona}_{\mathrm{A}}$ 's expression falls back to its characteristic expressionless gaze.
It seems like you 've got a good thing going with those two G .
“ I A have n't decided , yet , if I A should accept the invitation , ” they A shift a bit where they A stand .
Never having been the best at reassuring others, even his own meister, Soul kept his mouth shut to avoid stuttering while he searched for the right words a web of thoughts.
“ Y ’A know , I C think it ' s less of an invitation and more of an extended welcome . ”
The other raises their head, taken aback, "Oh," Crona mutters, in a poignant tone, "I... never considered something like that."
Soul does n't leave much wiggle room for their mood to fall any further ( nothing past a flat - lipped frown ) , “They ’d probably love to have you A , I C bet they drive each other nuts sometimes all by themselves G . ”
Though Evans C wo n't admit it, he C knows it's all too likely Stein H might actually put some more effort into taking care of himself H if he H had someone else besides Marie B to look after.
"I_A - I_A see , " they_A exhale with a nod , giving Soul_C a hint of affirmation that he_C 'd done something to boost the kid_A 's confidence .
"IC mean, it's got ta be lonely not to mention boring hanging here all summer ... and the weather , " SoulC nearly gasps, dramatizing it for added effect , " Oh , man , IC do n't know how youA can stay cooped up in that room of yoursA when it 's so nice out , " heC grins .
"But ... meh. Different strokes. I can't judge."
His comments comfort them, an for a moment they forget how this came to be. The cathedral in Italy, Lady Medusa's wrath, and the black blood that infected him. Every moment they spent in the presence of Soul Evans builds always up to this; fixation on the memories of their first encounters and all the pain they've caused him, the pain they've caused he and Maka both. As quickly as Soul had lifted the swordsman's spirits, they'd weighed themselves down once more. It seemed so normal, though. Soul could n't bring himself to feel any sense of accomplishment in the coaxing - out of Crona's smile when the return of their self doubt was as certain as the sun in the sky. His own stubbornness could not let his diminished self worth lie.
With another encouraging smile, rows of sharpened incisors appearing oddly charismatic, he opens his mouth to speak – but finds himself cut off before he can even squeeze a word in.
SoulC, I'A 'm sorry , ” the meisterA blurts
Having been pent - up for months , the apology comes forth without inhibition , rolling effortlessly off their A tongue
"Sorry ...? For what?" Evans quirks a brow, chuckling.
He adjusts his stance to face Crona with the whole of his body , maintaining his positive demeanor .
“F - for what ... ?”
TheyA stammer , shaking theirA head . For all theirA remorse , theyA thought this would have been obvious .
"For everything, it's ... the first time we'd dueled, Ia was the enemy! Ia - Ia almost killed youc, Ia - Ia ... Ia really, really hurt youc," theyA answer, still so sick with guild that even theirA confession of responsibility is tainted with frustration.
Soul seems stunned for a moment before harnessing his quick wit.
"Hey, now, you can't take all the credit like that, Ragnarok did most of the damage," he ...