MT rill: Machine Translation Impact on Language Learning (2022)

Abstract: This paper presents the MTrill project which aimed at investigating the impact of popular web-based machine transla-tion (MT) tools on the cognitive pro-cessing of English as a second language. The methodological approach and main results are presented.

## introduction the mtrill project was funded by the european union's horizon 2020 research and innovation programme under the marie sklodowska-curie grant agreement no 843455. the project started on the april 25 th 2019 and ended on july 16 th 2021. the project aimed at investigating the impact of popular web-based machine translation (mt) tools on the cognitive processing of english as a second language. the proposed research project was motivated by the observation that students of english as a second language are using web-based mt systems as a tool to support their english learning, due to the easy access to the systems through applications on their phones which provide instant translations for the input entered either by voice, text or image. the general research question of the project was: would the interaction with the output of the mt result in changes in the cognitive processing of english as a second language, reflected by the learning of structures seen in the output of the mt? to answer the research question, two laboratory studies were implemented in which participants © 2022 the authors. this article is licensed under a creative commons 3.0 licence, no derivative works, attribution, ccby-nd recruited were tested whether they would be primed by the mt output, i.e., whether the mt system would be capable of influencing the language production of participants. the specific objectives of the experiments are listed below: in the next section, we describe the methodological approach used in the experiments. ## methodology the mtrill project adopted the syntactic priming paradigm widely used behavioural method to study syntactic processing and encoding. syntactic priming can be defined as the tendency speakers have to use a syntactic structure that has been previously encountered @xcite . both experiments involved a pre-test phase, a priming test phase and an english proficiency test foot_0 . in experiment 2, a post-test phase was included. the pre-test phase was considered as the baseline, as in this phase, participants were not exposed to the mt output when translating sentences from portuguese into english. the priming phase involved a task in which participants were requested to translate sentences from portuguese into english using google translate (gt) application on their own mobile device and repeat the output out loud. immediately after this task, they were asked to describe images in english using words provided on the screen. if participants described the images in english using the syntactic structures previously seen in the output of the mt more frequently than the syntactic structures they used in the pre-test phase (which did not involve any interaction with mt), then our results would suggest that the mt system is capable of eliciting syntactic priming effects, that is, our results would suggest that mt system is influencing users linguistic behaviour in the second language. the post-test phase was included in experiment 2 with the aim of investigating whether any syntactic priming effect observed would be of implicit or explicit nature.