qanastek commited on
Commit
727c087
1 Parent(s): 643da1e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +156 -1
README.md CHANGED
@@ -8,4 +8,159 @@ widget:
8
  - text: "George Washington est allé à Washington"
9
  ---
10
 
11
- # POS Tagging French
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8
  - text: "George Washington est allé à Washington"
9
  ---
10
 
11
+ **People Involved**
12
+
13
+ * LABRAK Yanis (1)
14
+ * DUFOUR Richard (2)
15
+
16
+ **Affiliations**
17
+
18
+ 1. LIA, Avignon University, Avignon, France.
19
+ 2. LS2N, Nantes University, Nantes, France.
20
+
21
+ # French Part-Of-Speech (POS) Tagging
22
+
23
+ - Corpus: [UD_FRENCH_TREEBANKS](https://universaldependencies.org/treebanks/fr_gsd/index.html)
24
+ - Model: [Flair](https://www.aclweb.org/anthology/C18-1139.pdf)
25
+ - Embeddings: [FastText](https://fasttext.cc/)
26
+ - Additionnel: [LSTM-CRF](https://arxiv.org/abs/1011.4088)
27
+ - Nombre d'Epochs: 115
28
+
29
+ ## Demo: How to use in Flair
30
+
31
+ Requires [Flair](https://pypi.org/project/flair/): ```pip install flair```
32
+
33
+ ```python
34
+ from flair.data import Sentence
35
+ from flair.models import SequenceTagger
36
+
37
+ # Load the model
38
+ model = SequenceTagger.load("qanastek/pos-french")
39
+
40
+ sentence = Sentence("George Washington est allé à Washington")
41
+
42
+ # predict tags
43
+ model.predict(sentence)
44
+
45
+ # print predicted pos tags
46
+ print(sentence.to_tagged_string())
47
+ ```
48
+
49
+ Output:
50
+
51
+ ```bash
52
+ George <PROPN>
53
+ Washington <XFAMIL>
54
+ est <AUX>
55
+ allé <VPPMS>
56
+ à <PREP>
57
+ Washington <PROPN>
58
+ ```
59
+
60
+
61
+ ## Corpora
62
+
63
+ `UD_FRENCH_GSD_PLUS` is a part-of-speech tagging corpora based on [UD_French-GSD](https://universaldependencies.org/treebanks/fr_gsd/index.html) which was originally created in 2015 and is based on the [universal dependency treebank v2.0](https://github.com/ryanmcd/uni-dep-tb).
64
+
65
+ Originally, the corpora consists of 400,399 words (16,341 sentences) and had 17 different classes. Now, after applying our tags augmentation we obtains 60 different classes which add semantic information such as the gender, number, mood, person, tense or verb form.
66
+
67
+ ## Original Tags
68
+
69
+ ```plain
70
+ PRON VERB SCONJ ADP CCONJ DET NOUN ADJ AUX ADV PUNCT PROPN NUM SYM PART X INTJ
71
+ ```
72
+
73
+ ## New Tags
74
+
75
+ | Tag | Full Name | Examples |
76
+ |:--------:|:--------:|:--------:|
77
+ | PREP | Preposition | de |
78
+ | AUX | Auxiliary Verb | est |
79
+ | ADV | Adverb | toujours |
80
+ | COSUB | Subordinating conjunction | que |
81
+ | COCO | Coordinating Conjunction | et |
82
+ | PART | Demonstrative particle | -t |
83
+ | PRON | Pronoun | qui ce quoi |
84
+ | PDEMMS | Singular Masculine Demonstrative Pronoun | ce |
85
+ | PDEMMP | Plurial Masculine Demonstrative Pronoun | ceux |
86
+ | PDEMFS | Singular Feminine Demonstrative Pronoun | cette |
87
+ | PDEMFP | Plurial Feminine Demonstrative Pronoun | celles |
88
+ | PINDMS | Singular Masculine Indefinite Pronoun | tout |
89
+ | PINDMP | Plurial Masculine Indefinite Pronoun | autres |
90
+ | PINDFS | Singular Feminine Indefinite Pronoun | chacune |
91
+ | PINDFP | Plurial Feminine Indefinite Pronoun | certaines |
92
+ | PROPN | Proper noun | houston |
93
+ | XFAMIL | Last name | levy |
94
+ | NUM | Numerical Adjectives | trentaine vingtaine |
95
+ | DINTMS | Masculine Numerical Adjectives | un |
96
+ | DINTFS | Feminine Numerical Adjectives | une |
97
+ | PPOBJMS | Singular Masculine Pronoun complements of objects | le lui |
98
+ | PPOBJMP | Plurial Masculine Pronoun complements of objects | eux y |
99
+ | PPOBJFS | Singular Feminine Pronoun complements of objects | moi la |
100
+ | PPOBJFP | Plurial Feminine Pronoun complements of objects | en y |
101
+ | PPER1S | Personal Pronoun first Person Singular | je |
102
+ | PPER2S | Personal Pronoun second Person du Singular | tu |
103
+ | PPER3MS | Personal Pronoun third Person Masculine Singular | il |
104
+ | PPER3MP | Personal Pronoun third Person Masculine Plurial | ils |
105
+ | PPER3FS | Personal Pronoun third Person Feminine Singular | elle |
106
+ | PPER3FP | Personal Pronoun third Person Feminine Plurial | elles |
107
+ | PREFS | Reflexive Pronouns First Person of Singular | me m' |
108
+ | PREF | Reflexive Pronouns Third Person of Singular | se s' |
109
+ | PREFP | Reflexive Pronouns First / Second Person of Plurial | nous vous |
110
+ | VERB | Verb | obtient |
111
+ | VPPMS | Singular Masculine Participle Past Verb | formulé |
112
+ | VPPMP | Plurial Masculine Participle Past Verb | classés |
113
+ | VPPFS | Singular Feminine Participle Past Verb | appelée |
114
+ | VPPFP | Plurial Feminine Participle Past Verb | sanctionnées |
115
+ | DET | Determinant | les l' |
116
+ | DETMS | Singular Masculine Determinant | les |
117
+ | DETFS | Singular Feminine Determinant | la |
118
+ | ADJ | Adjective | capable sérieux |
119
+ | ADJMS | Singular Masculine Adjective | grand important |
120
+ | ADJMP | Plurial Masculine Adjective | grands petits |
121
+ | ADJFS | Singular Feminine Adjective | française petite |
122
+ | ADJFP | Plurial Feminine Adjective | légères petites |
123
+ | NOUN | Noun | temps |
124
+ | NMS | Singular Masculine Noun | drapeau |
125
+ | NMP | Plurial Masculine Noun | journalistes |
126
+ | NFS | Singular Feminine Noun | tête |
127
+ | NFP | Plurial Feminine Noun | ondes |
128
+ | PREL | Relative Pronoun | qui dont |
129
+ | PRELMS | Singular Masculine Relative Pronoun | lequel |
130
+ | PRELMP | Plurial Masculine Relative Pronoun | lesquels |
131
+ | PRELFS | Singular Feminine Relative Pronoun | laquelle |
132
+ | PRELFP | Plurial Feminine Relative Pronoun | lesquelles |
133
+ | INTJ | Interjection | merci bref |
134
+ | CHIF | Numbers | 1979 10 |
135
+ | SYM | Symbol | € % |
136
+ | YPFOR | Endpoint | . |
137
+ | PUNCT | Ponctuation | : , |
138
+ | MOTINC | Unknown words | Technology Lady |
139
+ | X | Typos & others | sfeir 3D statu |
140
+
141
+ ## Cite
142
+
143
+ Please cite the following paper when using this model.
144
+
145
+ UD_French-GSD corpora:
146
+
147
+ ```latex
148
+ @misc{
149
+ universaldependencies,
150
+ title={UniversalDependencies/UD_French-GSD},
151
+ url={https://github.com/UniversalDependencies/UD_French-GSD}, journal={GitHub},
152
+ author={UniversalDependencies}
153
+ }
154
+ ```
155
+
156
+ Flair Embeddings:
157
+
158
+ ```latex
159
+ @inproceedings{akbik2018coling,
160
+ title={Contextual String Embeddings for Sequence Labeling},
161
+ author={Akbik, Alan and Blythe, Duncan and Vollgraf, Roland},
162
+ booktitle = {{COLING} 2018, 27th International Conference on Computational Linguistics},
163
+ pages = {1638--1649},
164
+ year = {2018}
165
+ }
166
+ ```