The accuracy of the model on the annotation of the second block was roughly 70%, which corresponds to the accuracy on the test set. The manually-corrected additional tokens were added to the training data of our neural model, and a new block was automatically annotated and manually corrected. Both accuracy on the test set and on the annotation block remained at around 70%. This is because the block added to the training data was significantly different from the previous and from the third. Adding the third block to the training data and annotating a fourth block with the new trained model gave in contrast an accuracy of roughly 80%. This incremental, semi-automatic transcription procedure is in progress for the remaining blocks, but it is clear that it will make the corpus annotation increasingly easier and faster as the amount of training data will grow up. Our goal concerning transcription, is to have the 25,000 tokens mentioned in section SECREF19 annotated automatically and manually corrected. These data will constitute our gold annotated data, and they will be used to automatically transcribe further data.

We note that by combining sentence, paragraph and token index in the corpus, whole sentences can be reconstructed. However, from 5,000 tokens roughly 300 sentences could be reconstructed, which are far too few to be used for training a neural model. Instead, since tokens are transcribed at morpheme level, we split Arabish tokens into characters, and Arabic tokens into morphemes, and we treated each token itself as a sequence. Our model learns thus to map Arabish characters into Arabic morphemes. The 10-fold cross validation with this setting gave a token-level accuracy of roughly 71%. This result is not satisfactory on an absolute scale, however it is more than encouraging taking into account the small size of our data. This result means that less than 3 tokens, on average, out of 10, must be corrected to increase the size of our corpus. With this model we automatically transcribed into Arabic morphemes, roughly, 5,000 additional tokens, corresponding to the second annotation block. This can be manually annotated in at least 7,5 days, but thanks to the automatic annotation accuracy, it was manually corrected into 3 days.

Conclusions	In this paper we presented TArC, the first Tunisian Arabish Corpus annotated with morpho-syntactic information. We discussed the decisions taken in order to highlight the phonological and morphological features of TUN through the TA corpus structure. Concerning the building process, we have shown the steps undertaken and our effort intended to make the corpus as representative as possible of TA. We therefore described the texts collection stage, as well as the corpus building and the semi-automatic procedure adopted for transcribing TA into Arabic script, taking into account CODA* and CODA TUN guidelines. At the present stage of research, TArC consists of 25.000 tokens, however our work is in progress and for future research we plan to enforce the semi-automatic transcription, which has already shown encouraging results (accuracy = 70%). We also intend to realize a semi-automatic TA Part-Of-Speech tagger. Thus, we aim to develop tools for TA processing and, in so doing, we strive to complete the annotation levels (transcription, POS tag, lemmatization) semi-automatically in order to increase the size of the corpus, making it available for linguistic analyses on TA and TUN.

* The D column, W, is the index of the token in the sentence. When W corresponds to a range of numbers, it means that the token has been segmented in to its components, specified in the rows below. * The E column, Arabi, corresponds to the token transcription in Arabish. * The F column, Tra, is the transcription into Arabic characters. * The G column, Ita, is the translation to Italian. * The H column, Lem, corresponds to the lemma. * The I column, POS, is the Part-Of-Speech tag of the token. The tags that have been used for the POS tagging are conform to the annotation system of Universal Dependencies. * The last three columns (J, K, L) contain the metadata: Var, Age, Gen. Since TA is a spontaneous orthography of TUN, we considered important to adopt the CODA* guidelines as a model to produce a unified lemmatization for each token (column Lem in table TABREF32). In order to guarantee accurate transcription and lemmatization, we annotated manually the first 6,000 tokens with all the annotation levels.

Therefore, the TArC will be suitable for phonological, morphological, syntactic and semantic studies, both in the linguistic and the Natural Language Processing (NLP) domains. For these reasons, we decided to build a corpus which could highlight the structural characteristics of TA through different annotation levels, including Part of Speech (POS) tags and lemmatization. In particular, to facilitate the match with the already existing tools and studies for the Arabic language processing, we provide a transcription in Arabic characters at token level, following the Conventional Orthography for Dialectal Arabic guidelines CODA* (CODA star)  and taking into account the specific guidelines for TUN (CODA TUN) . Furthermore, even if the translation is not the main goal of this research, we have decided to provide an Italian translation of the TArC’s texts. Even though in the last few years ADs have received an increasing attention by the NLP community, many aspects have not been studied yet and one of these is the Arabish code-system. The first reason for this lack of research is the relatively recent widespread of its use: before the advent of the social media, Arabish usage was basically confined to text messaging.

To the best of our knowledge there are only five TUN corpora freely downloadable: one of these is the PADIC PADIC, composed of 6,400 sentences in six Arabic dialects, translated in Modern Standard Arabic (MSA), and annotated at sentence level. Two other corpora are the Tunisian Dialect Corpus Interlocutor (TuDiCoI) Tudicoi and the Spoken Tunisian Arabic Corpus (STAC) stac, which are both morpho-syntactically annotated. The first one is a spoken task-oriented dialogue corpus, which gathers a set of conversations between staff and clients recorded in a railway station. TuDiCoI consists of 21,682 words in client turns . The STAC is composed of 42,388 words collected from audio files downloaded from the web (as TV channels and radio stations files) . A different corpus is the TARIC Taric, which contains 20 hours of TUN speech, transcribed in Arabic characters . The last one is the TSAC Tsac, containing 17k comments from Facebook, manually annotated to positive and negative polarities . This corpus is the only one that contains TA texts as well as texts in Arabic characters.

For the present research, CODA* is considered the most convenient guideline to follow due to its extensive applicability, which will support comparative studies of corpora in different ADs. As we already mentioned, there are few NLP tools available for Arabish processing in comparison to the amount of NLP tools realized for Arabic. Considering the lack of spelling conventions for Arabish, previous effort has focused on automatic transliteration from Arabish to Arabic script, e.g. chalabi2012romanized, darwish2013arabizi, and al2014automatic. These three work are based on a character-to-character mapping model that aims at generating a range of alternative words that must then be selected through a linguistic model. A different method is presented in younes2018sequence, in which the authors present a sequence-to-sequence-based approach for TA-Arabic characters transliteration in both directions , . Regardless of the great number of work done on TUN automatic processing, there are not a lot of TUN corpora available for free .

Incremental and Semi-Automatic Transcription	In order to make the corpus collection easier and faster, we adopted a semi-automatic procedure based on sequential neural models , . Since transcribing Arabish into Arabic is by far the most important information to study the Arabish code-system, the semi-automatic procedure concerns only transcription from Arabish to Arabic script. In order to proceed, we used the first group of (roughly) 6,000 manually transcribed tokens as training and test data sets in a 10-fold cross validation setting with 9-1 proportions for training and test, respectively. As we explained in the previous section, French tokens were removed from the data. More precisely, whole sentences containing non-transcribable French tokens (code-switching) were removed from the data. Since at this level there is no way for predicting when a French word can be transcribed into Arabic and when it has to be left unchanged, French tokens create some noise for an automatic, probabilistic model. After removing sentences with French tokens, the data reduced to roughly 5,000 tokens. We chose this amount of tokens for annotation blocks in our incremental annotation procedure.

Indeed, in our transcriptions we report what has been produced in Arabish following CODA TUN rules, while in lemmatization we report the verb lemma. At the same time we segment the negative verb in its minor parts: the circumfix negation marks and the conjugated verb. For the first one, we describe the negative morphological structure in the Tra and Lem columns, as in table TABREF36. For the second one, as well as the other verbs, we provide transcription and lemmatization.

As can be seen in table TABREF35, the Hilalian phoneme [g] of the Turkish loanword gawriyya, has been transcribed and lemmatized with the grapheme <ق>, . * Glottal stop. As explained in CODA TUN, real initial and final glottal stops have almost disappeared in TUN. They remain in some words that are treated as exceptions, e.g. <أسئلة>, , question . Indeed, we transcribe the glottal stops only when it is usually pronounced, and if it does not, we do not write the glottal stops at the beginning of the word or at the end, neither in the transcription, nor in the lemmas. * Negation Marks. CODA TUN proposes to keep the MSA rule of maintaining a space between the first negation mark and the verb, in order to uniform CODA TUN to the first CODA . However, as DBLP:conf/lrec/ZribiBMEBH14 explains, in TUN this rule does not make really sense, but it should be done to preserve the consistency among the various CODA guidelines.

Introduction	Arabish is the romanization of Arabic Dialects (ADs) used for informal messaging, especially in social networks. This writing system provides an interesting ground for linguistic research, computational as well as sociolinguistic, mainly due to the fact that it is a spontaneous representation of the ADs, and because it is a linguistic phenomenon in constant expansion on the web. Despite such potential, little research has been dedicated to Tunisian Arabish (TA). In this paper we describe the work we carried to develop a flexible and multi-purpose TA resource. This will include a TA corpus, together with some tools that could be useful for analyzing the corpus and for its extension with new data. First of all, the resource will be useful to give an overview of the TA. At the same time, it will be a reliable representation of the Tunisian dialect (TUN) evolution over the last ten years: the collected texts date from 2009 to present. This selection was done with the purpose to observe to what extent the TA orthographic system has evolved toward a writing convention.

TArC: Incrementally and Semi-Automatically Collecting a Tunisian Arabish Corpus	This article describes the constitution process of the first morpho-syntactically annotated Tunisian Arabish Corpus (TArC). Arabish, also known as Arabizi, is a spontaneous coding of Arabic dialects in Latin characters and arithmographs (numbers used as letters). This code-system was developed by Arabic-speaking users of social media in order to facilitate the writing in the Computer-Mediated Communication (CMC) and text messaging informal frameworks. There is variety in the realization of Arabish amongst dialects, and each Arabish code-system is under-resourced, in the same way as most of the Arabic dialects. In the last few years, the focus on Arabic dialects in the NLP field has considerably increased. Taking this into consideration, TArC will be a useful support for different types of analyses, computational and linguistic, as well as for NLP tools training. In this article we will describe preliminary work on the TArC semi-automatic construction process and some of the first analyses we developed on TArC.

However, the landscape has changed considerably, and particularly thanks to the massive registration of users on Facebook since 2008. At that time, in Tunisia there were still no Arabic keyboards, neither for Personal Computers, nor for phones, so Arabic-speaking users designed TA for writing in social media (Table TABREF14). A second issue that has held back the study of Arabish is its lack of a standard orthography, and the informal context of use. It is important to note that also the ADs lack a standard code-system, mainly because of their oral nature. In recent years the scientific community has been active in producing various sets of guidelines for dialectal Arabic writing in Arabic characters: CODA (Conventional Orthography for Dialectal Arabic) . The remainder of the paper is organized as follows: section SECREF2 is an overview of NLP studies on TUN and TA; section SECREF3 describes TUN and TA; section SECREF4 presents the TArC corpus building process; section SECREF5 explains preliminary experiments with a semi-automatic transcription and annotation procedure, adopted for a faster and simpler construction of the TArC corpus; conclusions are drawn in section SECREF6

Related Work	In this section, we provide an overview of work done on automatic processing of TUN and TA. As briefly outlined above, many studies on TUN and TA aim at solving the lack of standard orthography. The first Conventional Orthography for Dialectal Arabic (CODA) was for Egyptian Arabic  and it was used by bies2014transliteration for Egyptian Arabish transliteration into Arabic script. The CODA version for TUN (CODA TUN) was developed by DBLP:conf/lrec/ZribiBMEBH14, and was used in many studies, like boujelbane2015traitements. Such work presents a research on automatic word recognition in TUN. Narrowing down to the specific field of TA, CODA TUN was used in masmoudi2015arabic to realize a TA-Arabic script conversion tool, implemented with a rule-based approach. The most extensive CODA is CODA*, a unified set of guidelines for 28 Arab city dialects .

Tunisian Arabish Corpus ::: Text collection	The corpus collection procedure is composed of the following steps: Thematic categories detection. Match of categories with sets of semantically related TA keywords. Texts and metadata extraction. Step UNKREF20. In order to build a Corpus that was as representative as possible of the linguistic system, it was considered useful to identify wide thematic categories that could represent the most common topics of daily conversations on CMC. In this regard, two instruments with a similar thematic organization have been employed: [nosep] ‘A Frequency Dictionary of Arabic’  In particular its ‘Thematic Vocabulary List’ (TVL). ‘Loanword Typology Meaning List’ A list of 1460 meanings (LTML) . The TVL consists of 30 groups of frequent words, each one represented by a thematic word. The second consists of 23 groups of basic meanings sorted by representative word heading. Considering that the boundaries between some categories are very blurred, some categories have been merged, such as Body and Health, (see table TABREF26). Some others have been eliminated, being not relevant for the purposes of our research, e.g.

Characteristics of Tunisian Arabic and Tunisian Arabish	The Tunisian dialect (TUN) is the spoken language of Tunisian everyday life, commonly referred to as الدَّارِجَة, ad-dārija, العَامِّيَّة, al-‘āmmiyya, or التُّونْسِي, . According to the traditional diatopic classification, TUN belongs to the area of Maghrebi Arabic, of which the other main varieties are Libyan, Algerian, Moroccan and the Ḥassānīya variety of Mauritania . Arabish is the transposition of ADs, which are mainly spoken systems, into written form, thus turning into a quasi-oral system (this topic will be discussed in section SECREF12). In addition, Arabish is not realized through Arabic script and consequently it is not subject to the Standard Arabic orthographic rules. As a result, it is possible to consider TA as a faithful written representation of the spoken TUN .

In addition, in order to provide a complete overview of the challenges faced during the building process, we will present the main Tunisian dialect characteristics and their encoding in Tunisian Arabish.

Colors, Opposites, Male names. In the end, we obtained 15 macro-categories listed in table TABREF26. Step UNKREF21. Aiming at easily detect texts and the respective seed URLs, without introducing relevant query biases, we decided to avoid using the category names as query keywords . Therefore, we associated to each category a set of TA keywords belonging to the basic Tunisian vocabulary. We found that a semantic category with three meanings was enough to obtain a sufficient number of keywords and URLs for each category. For example, to the category Family the meanings: son, wedding, divorce have been associated in all their TA variants, obtaining a set of 11 keywords (table TABREF26). Step UNKREF22. We collected about 25,000 words and the related metadata as first part of our corpus, which are being semi-automatically transcribed into Arabic characters (see next sections). We planned to increase the size of the corpus at a later time. Regarding the metadata, we have extracted the information published by users, focusing on the three types of information generally used in ethnographic studies: Gender: Male (M) and Female (F).

Characteristics of Tunisian Arabic and Tunisian Arabish ::: Tunisian Arabish	As previously mentioned, we consider Arabish a quasi-oral system. With quasi-orality it is intended the form of communication typical of Computer-Mediated Communication (CMC), characterized by informal tones, dependence on context, lack of attention to spelling and especially the ability to create a sense of collectivity . TA and TUN have not a standard orthography, with the exception of the CODA TUN. Nevertheless, TA is a spontaneous code-system used since more than ten years, and is being conventionalized by its daily usage. From the table TABREF14, where the coding scheme of TA is illustrated, it is possible to observe that there is no one-to-one correspondence between TA and TUN characters and that often Arabish presents overlaps in the encoding possibilities. The main issue is represented by the not proper representation by TA of the emphatic phones: , and .

Tunisian Arabish Corpus ::: Corpus Creation	In order to create our corpus, we applied a word-level annotation. This phase was preceded by some data pre-processing steps, in particular tokenization. Each token has been associated with its annotations and metadata (table TABREF32). In order to obtain the correspondence between Arabish and Arabic morpheme transcriptions, tokens were segmented into morphemes. This segmentation was carried out completely manually for a first group of tokens. In its final version, each token is associated with a total of 11 different annotations, corresponding to the number of the annotation levels we chose. An excerpt of the corpus after tokens annotation is depicted in table TABREF32. For the sake of clarity, in table TABREF32 we show: * The A column, Cor, indicates the tokens source code. For example, the code 3fE, which stands for 3rab fi Europe, is the forum from which the text was extracted. * The B column, Textco, is the publication date of the text. * The C column, Par, is the row index of the token in the paragraph.

Tunisian Arabish Corpus	In order to analyze the TA system, we have built a TA Corpus based on social media data, considering this as the best choice to observe the quasi-oral nature of the TA system.

Characteristics of Tunisian Arabic and Tunisian Arabish ::: Tunisian Arabic	The following list provides an excerpt of the principal features of TUN, which, through the TArC, would be researched in depth among many others. At the phonetic level, some of the main characteristics of TUN, and Maghrebi Arabic in general, are the following: 1em0pt * Strong influence of the Berber substratum, to which it is possible to attribute the conservative phonology of TUN consonants. 1em0pt * Presence of new emphatic phonemes, above all [ṛ], [ḷ], [ḅ]. * Realization of the voiced post-alveolar affricate [ʤ] as fricative . * Overlapping of the pharyngealized voiced alveolar stop , <ض>, with the fricative , <ظ>. * Preservation of a full glottal stop mainly in cases of loans from Classical Arabic (CA) or exclamations and interjections of frequent use. * Loss of short vowels in open syllables. * Monophthongization.

Some annotation decisions were taken before this step, with regard to specific TUN features: * Foreign words. We transcribed the Arabish words into Arabic characters, except for Code-Switching terms. In order to not interrupt the sentences continuity we decide to transcribe Code-Mixing terms into Arabic script. However, at the end of the corpus creation process, these words will be analyzed, making the distinction between acclimatized loans and Code-Mixing. The first ones will be transcribed into Arabic characters also in Lem, as shown in table TABREF33. The second ones will be lemmatized in the foreign language, mostly French, as shown in table TABREF34. * Typographical errors. Concerning typos and typical problems related to the informal writing habits in the web, such as repeated characters to simulate prosodic features of the language, we have not maintained all these characteristics in the transcription (column Tra). Logically, these were neither included in Lem, according to the CODA* conventions, as shown in table TABREF34. * Phono-Lexical exceptions. We used the grapheme <ڨ>, , only in loanword transcription and lemmatization.

In TUN <بَيت>, , house, becomes meaning room. * Palatalization of ā: Imāla, <إمالة>, literally inclination. (In TUN the phenomenon is of medium intensity.) Thereby the word <باب>, , door, becomes . * Metathesis. (Transposition of the first vowel of the word. It occurs when non-conjugated verbs or names without suffix begin with the sequence CCvC, where C stands for ungeminated consonant, and v for short vowel. When a suffix is added to this type of name, or a verb of this type is conjugated, the first vowel changes position giving rise to the CvCC sequence.) In TUN it results in: (he) has understood: <فْهِم>, , (she) has understood: <فِهْمِت>, or leg: <رْجِل>, , my leg: <رِجْلِي>, .

* Use of presentatives /ṛā-/ and /hā-/ with the meaning of here, look, as in the example in TUN: <راني مَخْنوق>, ṛ, here I am asphyxiated (by problems), or in <هاك دَبَّرْتْها>, , here you are, finding it (the solution) hence: you were lucky. * Presence of circumfix negation marks, such as < <ما>, + verb + <ش>, >. The last element of this structure must be omitted if there is another negation, such as the Tunisian adverb <عُمْر>, , never, as in the structure: < + personal pronoun suffix + + perfect verb>.

Regarding the morpho-syntactic level, TUN presents: 1em0pt * Addition of the prefix /-n/ to first person verbal morphology in muḍāri' (imperfective). * Realization of passive-reflexive verbs through the morpheme /-t/ prefixed to the verb as in the example: <سوريّة مالحَفْصيّة تْتِلْبِس>, , the shirts of Ḥafṣiya are not bad, (lit: they dress). * Loss of gender distinction at the 2nd and 3rd persons, at verbal and pronominal level. * Disappearance of the dual form from verbal and pronominal inflexion. There is a residual of pseudo-dual in some words fixed in time in their dual form. * Loss of relative pronouns flexion and replacement with the invariable form <اِلّي>, .

On the other hand, being TA not codified through the Arabic alphabet, it can well represent the phonetic realization of TUN, as shown by the following examples: * The Arabic alphabet is generally used for formal conversations in Modern Standard Arabic (MSA), the Arabic of formal situations, or in that of Classical Arabic (CA), the Arabic of the Holy Qur’ān, also known as ‘The Beautiful Language’. Like MSA and CA, also Arabic Dialects (ADs) can be written in the Arabic alphabet, but in this case it is possible to observe a kind of hypercorrection operated by the speakers in order to respect the writing rules of MSA. For example, in TUN texts written in Arabic script, it is possible to find a ‘silent vowel’ (namely an epenthetic alif <ا>) written at the beginning of those words starting with the sequence ‘#CCv’, which is not allowed in MSA. * Writing TUN in Arabic script, the Code-Mixing or Switching in foreign language will be unnaturally reduced.

Language Resource References	lrec2020W-xample-kc

This construction is used to express the concept of never having done the action in question, as in the example: <عُمري ما كُنْت نِتْصَوُّر...>, , I never imagined that.... Instead, to deny an action pointing out that it will never repeat itself again, a structure widely used is <[ma] + + + imperfective verb>, where the element within the circumfix marks is a grammaticalized element of verbal origin from CA: <عاد>, , meaning to go back, to reoccur, which gives the structure a sense of denied repetitiveness, as in the sentence: <هو ما عادِش يَرْجَع>, , he will not come back. Finally, to deny the nominal phrase, in TUN both the <موش>, , and the circumfix marks are frequently used. For the negative form of the verb to be in the present, circumfix marks can be combined with the personal suffix pronoun, placed between the marks, as in <مَانِيش>, , I am not.

Within the negation marks we can also find other types of nominal structures, such as: < + (mind) + personal pronoun suffix>, which has a value equivalent to the verb be aware of, as in the example: <ما في باليش>, , I did not know.

* As described in table TABREF14, the Arabic alphabet is provided with three short vowels, which correspond to the three long ones: , , , but TUN presents a wider range of vowels. Indeed, regarding the early presented characteristics of TUN, the TA range of vowels offers better possibility to represent most of the TUN characteristics outlined in the previous subsection, in particular: [nosep] Palatalization. Vowel metathesis. Monophthongization.

Age range: [10-25], [25-35], [35-50], [50-90]. City of origin.

As far as we know there are no available corpora of TA transcribed in Arabic characters which are also morpho-syntactically annotated. In order to provide an answer to the lack of resources for TA, we decided to create TArC, a corpus entirely dedicated to the TA writing system, transcribed in CODA TUN and provided with a lemmatization level and POS tag annotation.

Question: Does the paper report translation accuracy for an automatic translation model for Tunisian to Arabish words?
Answer: Yes