# A Maturity Model for Trustworthy AI Software Development
## 5 Conclusions
\begin{table}
\begin{tabular}{c c c} \hline \hline
**Component** & **Item** & **Description** \\ \hline \multirow{3}{*}{Model information} & Purpose & The text translation model is developed to provide cloud translation services and supports eight languages (En, Ko, Es, Fr, De, It, Ru, Pt) \\ \cline{2-3}  & Model architecture & The neural machine translation uses transformers \\ \cline{2-3}  & Inputs and outputs & Input: source text (UTF-8), output: target text (UTF-8) and result status \\ \hline \multirow{3}{*}{Training data} & Characteristics & Everyone’s corpus ([[https://corpus.korean.go.kr/](https://corpus.korean.go.kr/)]([https://corpus.korean.go.kr/](https://corpus.korean.go.kr/)), accessed on 30 March 2023), AI Hub, Wikipedia \\ \cline{2-3}  & Training method & Preprocessing, such as deduplication and noise removal filtering, subword tokenization with 32 Nvidia V100 GPUs, dropout 0.2, optimizer 'adam’ \\ \hline \multirow{3}{*}{Evaluation data} & Characteristics & Flitto3000 (mixture), merge800 (mixture), iwslt (ted talk), flores (wikimedia) \\ \cline{2-3}  & Testing method & Access the AI model using the translation API, extract translation results, and measure the BLEU score (using SacreBLEU tool) through scripts \\ \hline \multirow{3}{*}{Performance metrics} & Name \& formula & BLEU (BiLingual Evaluation Understudy) score \\  & & Formula: [[https://en.wikipedia.org/wiki/BLEU](https://en.wikipedia.org/wiki/BLEU)]([https://en.wikipedia.org/wiki/BLEU](https://en.wikipedia.org/wiki/BLEU)) (accessed on 22 February 2023) \\ \cline{2-3}  & Evaluation method & Use benchmark evaluation tools to execute and analyze (measure the comparison of correct answers with the translation results obtained through the API call) \\ \cline{2-3}  & Evaluation result & BLEU scores (equal and superior to major companies) \\ \hline \multirow{3}{*}{Ethics} & \multirow{3}{*}{Fairness} & - A translation is a task that faithfully converts a given input into the target language and does not judge the input - Bias may occur in the process of restoring an input statement with missing subjects or objects with any pronoun, depending on the target language - It is equipped with the function of filtering abusive language, which may offend users, when outputting machine translation results \\  & & Bias may occur; for example, when the names of famous politicians or celebrities may be translated into unintended names or nicknames \\ \hline \hline \end{tabular}
\end{table} 
Table 15: Part of the AI model card of the language translation project. **Author Contributions:** Conceptualization, S.C.; methodology, S.C. and H.W. ; formal analysis, I.K. and H.W. ; investigation, I.K. ; resources, S.C.; data curation, I.K. ; writing--original draft preparation, J.K. and I.K. ; writing--review and editing, S.C., H.W. and W.S. ; visualization, J.K. and I.K. ; supervision, W.S. ; project administration, I.K. All authors have read and agreed to the published version of the manuscript. **Funding:** This research was funded in part by the Institute for Information & communications Technology Planning & Evaluation (IITP) under grant No. 2022-0-01045 and 2022-0-00043, and in part by the ICT Creative Consilience program supervised by the IITP under grant No. IITP-2020-0-01821. **Institutional Review Board Statement:** Not applicable. **Informed Consent Statement:** Not applicable. **Data Availability Statement:** Not applicable. **Acknowledgments:** We would like to acknowledge anonymous reviewers for their valuable comments and our Samsung colleagues [PERSON], [PERSON], and [PERSON] for their work and support. **Conflicts of Interest:** The authors declare no conflict of interest.