title: Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° Ð²Ð¸ÑÑÑÐ°Ð»ÑÐ½Ð¾Ð³Ð¾ Ð°ÑÑÐ¸ÑÑÐµÐ½ÑÐ° Ð´Ð»Ñ Ð¾ÑÐµÐ½Ð¸Ð²Ð°Ð½Ð¸Ñ ÑÐµÐºÑÑÐ¾Ð²ÑÑ Ð¾ÑÐ²ÐµÑÐ¾Ð² Ð½Ð° ÑÐºÐ·Ð°Ð¼ÐµÐ½Ð°ÑÐ¸Ð¾Ð½Ð½ÑÐµ Ð²Ð¾Ð¿ÑÐ¾ÑÑ
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð±Ð°ÐºÐ°Ð»Ð°Ð²ÑÐ°
titleType: Subtitle
title: Virtual assistant development for assessing text answers to exam questions
Creators: name: ÐÐ²Ð°Ð½Ð¾Ð², ÐÐ¸ÑÐ¸Ð»Ð»
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2024
Subjects: Ð¿Ð¸ÑÑÐ¼ÐµÐ½Ð½ÑÐ¹ ÑÐºÐ·Ð°Ð¼ÐµÐ½
Ð²Ð¸ÑÑÑÐ°Ð»ÑÐ½ÑÐ¹ Ð°ÑÑÐ¸ÑÑÐµÐ½Ñ
Ð¼ÐµÑÑÐ¸ÐºÐ° Ð¾ÑÐµÐ½Ð¸Ð²Ð°Ð½Ð¸Ñ
Ð±Ð¾Ð»ÑÑÐ°Ñ ÑÐ·ÑÐºÐ¾Ð²Ð°Ñ Ð¼Ð¾Ð´ÐµÐ»Ñ
Ð°ÑÑ Ð¸ÑÐµÐºÑÑÑÐ° ÐºÐ»Ð¸ÐµÐ½Ñ-ÑÐµÑÐ²ÐµÑ
Ð¼Ð¾Ð±Ð¸Ð»ÑÐ½Ð¾Ðµ Ð¿ÑÐ¸Ð»Ð¾Ð¶ÐµÐ½Ð¸Ðµ
Kotlin
written exam
virtual assistant
assessment metric
large language model
client-server architecture
mobile application

description: Ð Ð°Ð±Ð¾ÑÐ° Ð¿Ð¾ÑÐ²ÑÑÐµÐ½Ð° Ð¿Ð¾ÑÑÑÐ¾ÐµÐ½Ð¸Ñ Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ, Ð¿ÑÐµÐ´Ð½Ð°Ð·Ð½Ð°ÑÐµÐ½Ð½Ð¾Ð¹ Ð´Ð»Ñ Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð°ÑÐ¸Ð¸ Ð¿ÑÐµÐ´Ð²Ð°ÑÐ¸ÑÐµÐ»ÑÐ½Ð¾Ð³Ð¾ Ð¾ÑÐµÐ½Ð¸Ð²Ð°Ð½Ð¸Ñ Ð¿Ð¸ÑÑÐ¼ÐµÐ½Ð½ÑÑ Ð¾ÑÐ²ÐµÑÐ¾Ð² ÑÑÑÐ´ÐµÐ½ÑÐ¾Ð² Ð½Ð° ÑÐºÐ·Ð°Ð¼ÐµÐ½Ð°ÑÐ¸Ð¾Ð½Ð½ÑÐµ Ð²Ð¾Ð¿ÑÐ¾ÑÑ. ÐÑÐµÐ´Ð²Ð°ÑÐ¸ÑÐµÐ»ÑÐ½Ð¾Ðµ Ð¾ÑÐµÐ½Ð¸Ð²Ð°ÐµÑÑÑ Ð²ÑÐ¿Ð¾Ð»Ð½ÑÐµÑÑÑ Ð²Ð¸ÑÑÑÐ°Ð»ÑÐ½ÑÐ¼ Ð°ÑÑÐ¸ÑÑÐµÐ½ÑÐ¾Ð¼, ÑÐµÐ°Ð»Ð¸Ð·Ð¾Ð²Ð°Ð½Ð½ÑÐ¼ Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð±Ð¾Ð»ÑÑÐ¾Ð¹ ÑÐ·ÑÐºÐ¾Ð²Ð¾Ð¹ Ð¼Ð¾Ð´ÐµÐ»Ð¸, Ñ Ð¿Ð¾Ð¼Ð¾ÑÑÑ ÑÐ¾Ð²Ð¾ÐºÑÐ¿Ð½Ð¾ÑÑÐ¸ Ð¼ÐµÑÑÐ¸Ðº. Ð£ÐºÐ°Ð·Ð°Ð½Ð½ÑÐµ Ð¼ÐµÑÑÐ¸ÐºÐ¸ ÑÐ¾ÑÐ¼Ð°Ð»Ð¸Ð·ÑÑÑ ÐºÑÐ¸ÑÐµÑÐ¸Ð¸ Ð²ÑÑÑÐ°Ð²Ð»ÐµÐ½Ð¸Ñ Ð¾ÑÐµÐ½Ð¾Ðº, Ð¸ÑÐ¿Ð¾Ð»ÑÐ·ÑÐµÐ¼ÑÐµ ÑÐºÐ·Ð°Ð¼ÐµÐ½Ð°ÑÐ¾ÑÐ°Ð¼Ð¸-Ð»ÑÐ´ÑÐ¼Ð¸: Ð¿ÑÐ°Ð²Ð¸Ð»ÑÐ½Ð¾ÑÑÑ, ÐºÑÐ°ÑÐºÐ¾ÑÑÑ, ÑÑÐ¸Ð»Ñ, Ð¿Ð¾Ð»Ð½Ð¾ÑÐ°, ÑÐ²ÑÐ·Ð½Ð¾ÑÑÑ Ð¾ÑÐ²ÐµÑÐ¾Ð². ÐÐ»Ñ ÐºÐ°Ð¶Ð´Ð¾Ð¹ Ð¼ÐµÑÑÐ¸ÐºÐ¸ Ð¾Ð¿ÑÐµÐ´ÐµÐ»ÐµÐ½Ð° 10-Ð±Ð°Ð»Ð»ÑÐ½Ð°Ñ ÑÐºÐ°Ð»Ð°. ÐÑÐ¾Ð³Ð¾Ð²Ð°Ñ Ð¾ÑÐµÐ½ÐºÐ° ÑÐ¾ÑÐ¼Ð¸ÑÑÐµÑÑÑ ÑÐºÐ·Ð°Ð¼ÐµÐ½Ð°ÑÐ¾ÑÐ¾Ð¼ ÑÐ°Ð¼Ð¾ÑÑÐ¾ÑÑÐµÐ»ÑÐ½Ð¾ Ñ ÑÑÐµÑÐ¾Ð¼ Ð²ÐµÐºÑÐ¾ÑÐ° Ð¿ÑÐµÐ´Ð²Ð°ÑÐ¸ÑÐµÐ»ÑÐ½ÑÑ Ð¾ÑÐµÐ½Ð¾Ðº. ÐÐ·Ð°Ð¸Ð¼Ð¾Ð´ÐµÐ¹ÑÑÐ²Ð¸Ðµ ÑÑÐ°ÑÑÐ½Ð¸ÐºÐ¾Ð² Ð¿Ð¸ÑÑÐ¼ÐµÐ½Ð½Ð¾Ð³Ð¾ ÑÐºÐ·Ð°Ð¼ÐµÐ½Ð° (ÑÐºÐ·Ð°Ð¼ÐµÐ½Ð°ÑÐ¾ÑÐ° Ð¸ ÑÑÑÐ´ÐµÐ½ÑÐ¾Ð²) Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸Ð·Ð¸ÑÐ¾Ð²Ð°Ð½Ð¾ Ñ Ð¿Ð¾Ð¼Ð¾ÑÑÑ ÐºÐ»Ð¸ÐµÐ½Ñ-ÑÐµÑÐ²ÐµÑÐ½Ð¾Ð³Ð¾ Ð¼Ð¾Ð±Ð¸Ð»ÑÐ½Ð¾Ð³Ð¾ Ð¿ÑÐ¸Ð»Ð¾Ð¶ÐµÐ½Ð¸Ñ, ÑÐµÐ°Ð»Ð¸Ð·Ð¾Ð²Ð°Ð½Ð½Ð¾Ð³Ð¾ Ð½Ð° ÑÐ·ÑÐºÐµ Kotlin. Ð Ð´Ð¾Ð¿Ð¾Ð»Ð½ÐµÐ½Ð¸Ðµ Ðº Ð¾ÑÐ½Ð¾Ð²Ð½Ð¾Ð¹ ÑÑÐ½ÐºÑÐ¸Ð¾Ð½Ð°Ð»ÑÐ½Ð¾ÑÑÐ¸ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½Ð½Ð°Ñ Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½Ð°Ñ ÑÐ¸ÑÑÐµÐ¼Ð° Ð¿Ð¾Ð´Ð´ÐµÑÐ¶Ð¸Ð²Ð°ÐµÑ ÑÐ»ÐµÐ´ÑÑÑÐ¸Ðµ ÑÐµÑÐ²Ð¸ÑÑ: Ð¿ÑÐ¾ÑÐ¾ÐºÐ¾Ð»Ð¸ÑÐ¾Ð²Ð°Ð½Ð¸Ðµ ÑÐ¾Ð´Ð° ÑÐºÐ·Ð°Ð¼ÐµÐ½Ð°, ÐºÐ°ÑÐ°Ð»Ð¾Ð³Ð¸Ð·Ð°ÑÐ¸Ñ ÑÐºÐ·Ð°Ð¼ÐµÐ½Ð°ÑÐ¸Ð¾Ð½Ð½ÑÑ ÑÐµÑÑÐ¸Ð¹, Ð°Ð²ÑÐ¾Ð½Ð¾Ð¼Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð¿ÑÐ¸ Ð¾ÑÑÑÑÑÑÐ²Ð¸Ð¸ Ð¿Ð¾ÑÑÐ¾ÑÐ½Ð½Ð¾Ð¹ ÑÐ²ÑÐ·Ð¸ Ñ ÑÐµÑÐ²ÐµÑÐ¾Ð¼, Ð¼Ð°Ð½Ð´Ð°ÑÐ½ÑÐ¹ Ð´Ð¾ÑÑÑÐ¿ Ð°Ð²ÑÐ¾ÑÐ¸Ð·Ð¾Ð²Ð°Ð½Ð½ÑÑ Ð¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°ÑÐµÐ»ÐµÐ¹ Ðº Ð°ÑÑÐ¸Ð²Ð½ÑÐ¼ Ð·Ð°Ð¿Ð¸ÑÑÐ¼ ÑÐºÐ·Ð°Ð¼ÐµÐ½Ð¾Ð². ÐÑÐ¿Ð¾Ð»Ð½ÐµÐ½Ð¾ Ð¼Ð¾Ð´ÑÐ»ÑÐ½Ð¾Ðµ ÑÐµÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ðµ Ð²ÑÐµÑ ÐºÐ¾Ð¼Ð¿Ð¾Ð½ÐµÐ½ÑÐ¾Ð² ÑÐµÐ»ÐµÐ²Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ Ð¸ ÐµÐµ Ð°Ð¿ÑÐ¾Ð±Ð°ÑÐ¸Ñ Ñ Ð¿Ð¾Ð¼Ð¾ÑÑÑ Ð¼ÐµÑÐ¾Ð´Ð¸ÑÐµÑÐºÐ¸Ñ Ð¼Ð°ÑÐµÑÐ¸Ð°Ð»Ð¾Ð² Ð²ÑÐ·Ð¾Ð²ÑÐºÐ¸Ñ ÑÑÐµÐ±Ð½ÑÑ ÐºÑÑÑÐ¾Ð².
description: The work is devoted to the construction of a software system designed to automate the preliminary assessment of students written answers to exam questions. The preliminary assessment is performed by a virtual assistant, implemented on the basis of a large language model, using a set of metrics. These metrics formalize the scoring criteria used by human examiners: correctness, brevity, style, completeness, coherence of answers. For each metric, a 10-point scale is defined. The final grade is formed by the examiner independently, taking into account the vector of preliminary grades. The interaction of participants in the written exam (examiner and students) is automated using a client-server mobile application implemented in the Kotlin language. In addition to the main functionality, the developed software system supports the following services: logging exam progress, cataloging exam sessions, autonomous work in the absence of a permanent connection to the server, mandatory access for authorized users to archived exam records. Unit testing of all components of the target system was carried out and it was tested using methodological materials of university training courses.