title: ÐÐ½ÑÐµÐ»Ð»ÐµÐºÑÑÐ°Ð»ÑÐ½Ð°Ñ Ð¼ÐµÐ´Ð¸ÑÐ¸Ð½ÑÐºÐ°Ñ ÑÐ¸ÑÑÐµÐ¼Ð° Ñ ÑÑÐ°Ð½ÑÑÐ¾ÑÐ¼Ð°ÑÐ¾ÑÐ½Ð¾Ð¹ Ð°ÑÑ Ð¸ÑÐµÐºÑÑÑÐ¾Ð¹ Ð¸ ÑÑÐµÐ´ÑÑÐ²Ð°Ð¼Ð¸ ÑÐ¾ÑÐ¼Ð¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ ÑÐ»Ð¾Ð¶Ð½ÑÑ Ð·Ð°Ð¿ÑÐ¾ÑÐ¾Ð²
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð¼Ð°Ð³Ð¸ÑÑÑÐ°
titleType: Subtitle
title: Intelligent system based on transformers architecture and means for complex queries
Creators: name: Ð­ÑÐ¿Ð¸Ð½Ð¾Ð»Ð° Ð Ð¸Ð²ÐµÑÐ°, Ð¥Ð¾Ð»ÑÐ³ÐµÑ
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2024
Subjects: Ð¸Ð½ÑÐµÐ»Ð»ÐµÐºÑÑÐ°Ð»ÑÐ½Ð°Ñ ÑÐ¸ÑÑÐµÐ¼Ð°
ÑÑÐ°Ð½ÑÑÐ¾ÑÐ¼ÐµÑ
Ð±Ð¾Ð»ÑÑÐ°Ñ ÑÐ·ÑÐºÐ¾Ð²Ð°Ñ Ð¼Ð¾Ð´ÐµÐ»Ñ
Ð¿Ð¾Ð¸ÑÐºÐ°Ñ ÑÐ°ÑÑÐ¸ÑÐµÐ½Ð½Ð°Ñ Ð³ÐµÐ½ÐµÑÐ°ÑÐ¸Ñ
ÑÐ°Ðº ÐºÐ¾Ð¶Ð¸
intelligent system
transformer
large language model
retrieval augmentation generation
skin cancer

description: Ð¢ÐµÐ¼Ð° Ð²ÑÐ¿ÑÑÐºÐ½Ð¾Ð¹ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð¾Ð¹ ÑÐ°Ð±Ð¾ÑÑ: Â«ÐÐ½ÑÐµÐ»Ð»ÐµÐºÑÑÐ°Ð»ÑÐ½Ð°Ñ Ð¼ÐµÐ´Ð¸ÑÐ¸Ð½ÑÐºÐ°Ñ ÑÐ¸ÑÑÐµÐ¼Ð° Ñ ÑÑÐ°Ð½ÑÑÐ¾ÑÐ¼ÐµÑÐ½Ð¾Ð¹ Ð°ÑÑÐ¸ÑÐµÐºÑÑÑÐ¾Ð¹ Ð¸ ÑÑÐµÐ´ÑÑÐ²Ð°Ð¼Ð¸ ÑÐ¾ÑÐ¼Ð¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ ÑÐ»Ð¾Ð¶Ð½ÑÑ Ð·Ð°Ð¿ÑÐ¾ÑÐ¾Ð²Â». Ð¦ÐµÐ»Ñ BKP: Ð ÐµÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ñ Ð¸Ð½ÑÐµÐ»Ð»ÐµÐºÑÑÐ°Ð»ÑÐ½Ð¾Ð¹ Ð¼ÐµÐ´Ð¸ÑÐ¸Ð½ÑÐºÐ¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ, Ð¾Ð±ÑÐµÐ´Ð¸Ð½ÑÑÑÐµÐ¹ Ð¼Ð¾Ð´ÐµÐ»Ñ ÐºÐ¾Ð¼Ð¿ÑÑÑÐµÑÐ½Ð¾Ð³Ð¾ Ð·ÑÐµÐ½Ð¸Ñ Ð´Ð»Ñ Ð´Ð¸Ð°Ð³Ð½Ð¾ÑÑÐ¸ÐºÐ¸ ÑÐ°ÐºÐ° ÐºÐ¾Ð¶Ð¸ Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð¸Ð·Ð¾Ð±ÑÐ°Ð¶ÐµÐ½Ð¸Ð¹ Ñ Ð¼Ð¾Ð´ÑÐ»ÐµÐ¼ Ð¼ÐµÐ´Ð¸ÑÐ¸Ð½ÑÐºÐ¾Ð¹ Ð¿Ð¾Ð¼Ð¾ÑÐ¸ Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ðµ ÑÑÐµÐ´ÑÑÐ² ÑÐ¾ÑÐ¼Ð¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ ÑÐ»Ð¾Ð¶Ð½ÑÑ Ð·Ð°Ð¿ÑÐ¾ÑÐ¾Ð², Ð³ÐµÐ½ÐµÑÐ¸ÑÑÑÑÐ¸Ñ Ð´Ð¾ÑÑÐ¾Ð²ÐµÑÐ½ÑÐµ, Ð²ÑÑÐ¾ÐºÐ¾ÑÐµÑÐ½Ð¸ÑÐ½ÑÐµ Ð¾ÑÐ²ÐµÑÑ, Ð¾ÑÐµÐ½ÐºÐ° ÑÐ¾Ð¾ÑÐ²ÐµÑÑÑÐ²Ð¸Ñ ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÐ¾Ð² ÑÐ°Ð±Ð¾ÑÑ ÑÐ¸ÑÑÐµÐ¼Ñ Ð¼ÐµÐ´Ð¸ÑÐ¸Ð½ÑÐºÐ¸Ð¼ Ð¸ÑÑÐ¸Ð½Ð°Ð¼ Ð½Ð° Ð²Ð¾Ð¿ÑÐ¾ÑÑ, Ð·Ð°Ð´Ð°Ð²Ð°ÐµÐ¼ÑÐµ ÑÐ¿ÐµÑÐ¸Ð°Ð»Ð¸ÑÑÐ°Ð¼Ð¸ Ð² Ð¾Ð±Ð»Ð°ÑÑÐ¸ Ð¾Ð½ÐºÐ¾Ð»Ð¾Ð³Ð¸ÑÐµÑÐºÐ¾Ð¹ Ð´ÐµÑÐ¼Ð°ÑÐ¾Ð»Ð¾Ð³Ð¸Ð¸. ÐÐµÑÐ¾Ð´Ñ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ: ÐÐ¸Ð°Ð³Ð½Ð¾ÑÑÐ¸ÐºÐ° ÑÐ¸Ð¿Ð° ÑÐ°ÐºÐ° ÐºÐ¾Ð¶Ð¸ Ð¸ Ð¾ÑÐ²ÐµÑ Ð½Ð° Ð²Ð¾Ð¿ÑÐ¾ÑÑ Ð¼ÐµÐ´Ð¸ÑÐ¸Ð½ÑÐºÐ¾Ð¹ Ð¿Ð¾Ð¼Ð¾ÑÐ¸ Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ðµ ÑÐµÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ð¸ Ð°ÑÑÐ¸ÑÐµÐºÑÑÑÑ Vision Transformer Ð¸ ÑÑÐµÐ´ÑÑÐ² Ð³ÐµÐ½ÐµÑÐ°ÑÐ¸Ð¸ ÑÐ»Ð¾Ð¶Ð½ÑÑ Ð·Ð°Ð¿ÑÐ¾ÑÐ¾Ð², Ð¸Ð½ÑÐµÐ³ÑÐ¸ÑÑÑÑÐ¸Ñ Biomistral-7B LLM, Ð½Ð°Ð¸Ð²Ð½ÑÑ Ð¿Ð¾Ð¸ÑÐºÐ¾Ð²ÑÑ ÑÐ¸ÑÑÐµÐ¼Ñ ÑÐ°ÑÑÐ¸ÑÐµÐ½Ð½Ð¾Ð¹ Ð³ÐµÐ½ÐµÑÐ°ÑÐ¸Ð¸ Ð¸ Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸ÑÐµÑÐºÑÑ ÑÐ¸ÑÑÐµÐ¼Ñ Ð¾ÑÐµÐ½ÐºÐ¸ Ð¾ÑÐ²ÐµÑÐ¾Ð² Ð½Ð° Ð²Ð¾Ð¿ÑÐ¾ÑÑ Ñ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð¸ÐµÐ¼ ÑÑÐµÐ¹Ð¼Ð²Ð¾ÑÐºÐ° RAGAS Ð² Ð¸Ð½ÑÐµÐ»Ð»ÐµÐºÑÑÐ°Ð»ÑÐ½Ð¾Ð¹ Ð¼ÐµÐ´Ð¸ÑÐ¸Ð½ÑÐºÐ¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ðµ. ÐÑÐ½Ð¾Ð²Ð½ÑÐµ ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÑ ÑÐ°Ð±Ð¾ÑÑ: Ð ÐµÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ñ Ð¸Ð½ÑÐµÐ»Ð»ÐµÐºÑÑÐ°Ð»ÑÐ½Ð¾Ð¹ Ð¼ÐµÐ´Ð¸ÑÐ¸Ð½ÑÐºÐ¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ Ð½Ð° Python Ñ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð¸ÐµÐ¼ Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½ÑÑ ÑÐ°Ð±Ð»Ð¾Ð½Ð¾Ð² Flask model-view-template; ÑÐµÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ñ Ð¼Ð¾Ð´ÑÐ»Ñ Ð´Ð»Ñ Ð´Ð¸Ð°Ð³Ð½Ð¾ÑÑÐ¸ÐºÐ¸ ÑÐ°ÐºÐ° ÐºÐ¾Ð¶Ð¸; ÑÐµÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ñ Ð¼Ð¾Ð´ÑÐ»Ñ Ð´Ð»Ñ Ð¾ÐºÐ°Ð·Ð°Ð½Ð¸Ñ Ð¼ÐµÐ´Ð¸ÑÐ¸Ð½ÑÐºÐ¾Ð¹ Ð¿Ð¾Ð¼Ð¾ÑÐ¸ Ð² Ð²Ð¸Ð´Ðµ Ð¾ÑÐ²ÐµÑÐ¾Ð² Ð½Ð° Ð²Ð¾Ð¿ÑÐ¾ÑÑ; ÑÐµÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ñ Ð¼Ð¾Ð´ÑÐ»Ñ Ð´Ð»Ñ Ð°Ð²ÑÐ¾Ð¼Ð°ÑÐ¸ÑÐµÑÐºÐ¾Ð¹ Ð¾ÑÐµÐ½ÐºÐ¸ ÑÑÐµÐ´ÑÑÐ² Ð³ÐµÐ½ÐµÑÐ°ÑÐ¸Ð¸ ÑÐ»Ð¾Ð¶Ð½ÑÑ Ð·Ð°Ð¿ÑÐ¾ÑÐ¾Ð²; ÑÐ°Ð·Ð²ÐµÑÑÑÐ²Ð°Ð½Ð¸Ðµ Ð¼Ð¾Ð´ÑÐ»ÐµÐ¹ Ð¸Ð½ÑÐµÐ»Ð»ÐµÐºÑÑÐ°Ð»ÑÐ½Ð¾Ð¹ Ð¼ÐµÐ´Ð¸ÑÐ¸Ð½ÑÐºÐ¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ Ñ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð¸ÐµÐ¼ Docker. ÐÐ±Ð»Ð°ÑÑÑ Ð¿ÑÐ¸Ð¼ÐµÐ½ÐµÐ½Ð¸Ñ ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÐ¾Ð² ÐÐÐ : Ð ÐµÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ñ Ð¸Ð½ÑÐµÐ»Ð»ÐµÐºÑÑÐ°Ð»ÑÐ½Ð¾Ð¹ Ð¼ÐµÐ´Ð¸ÑÐ¸Ð½ÑÐºÐ¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ Ð¸ Ð¾ÑÐµÐ½ÐºÐ° Ð¿ÑÐ¾Ð¸Ð·Ð²Ð¾Ð´Ð¸ÑÐµÐ»ÑÐ½Ð¾ÑÑÐ¸ Ð´Ð»Ñ Ð¼Ð¾Ð´ÐµÐ»Ð¸ Vision Transformer Ð² Ð·Ð°Ð´Ð°ÑÐµ Ð´Ð¸Ð°Ð³Ð½Ð¾ÑÑÐ¸ÐºÐ¸ ÑÐ°ÐºÐ° ÐºÐ¾Ð¶Ð¸, Ð° ÑÐ°ÐºÐ¶Ðµ Ð¾ÑÐµÐ½ÐºÐ° ÐºÐ°ÑÐµÑÑÐ²Ð° Ð¿Ð¾Ð¸ÑÐºÐ° Ð¸Ð½ÑÐ¾ÑÐ¼Ð°ÑÐ¸Ð¸ Ð¸ Ð³ÐµÐ½ÐµÑÐ°ÑÐ¸Ð¸ Ð¾ÑÐ²ÐµÑÐ¾Ð² Ð² ÑÑÐµÐ´ÑÑÐ²Ð°Ñ ÑÐ¾ÑÐ¼Ð¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ ÑÐ»Ð¾Ð¶Ð½ÑÑ Ð·Ð°Ð¿ÑÐ¾ÑÐ¾Ð². ÐÑÐ²Ð¾Ð´Ñ: ÐÐ½ÑÐµÐ»Ð»ÐµÐºÑÑÐ°Ð»ÑÐ½Ð°Ñ Ð¼ÐµÐ´Ð¸ÑÐ¸Ð½ÑÐºÐ°Ñ ÑÐ¸ÑÑÐµÐ¼Ð° Ð´Ð¾ÑÑÐ¸Ð³Ð°ÐµÑ Ð²ÑÑÐ¾ÐºÐ¾Ð¹ Ð¿ÑÐ¾Ð¸Ð·Ð²Ð¾Ð´Ð¸ÑÐµÐ»ÑÐ½Ð¾ÑÑÐ¸ Ð¸ ÑÐ¾ÑÐ½ÑÑ ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÐ¾Ð² Ð² Ð¼Ð¾Ð´ÑÐ»Ðµ Ð´Ð¸Ð°Ð³Ð½Ð¾ÑÑÐ¸ÐºÐ¸ ÑÐ¸Ð¿Ð° ÑÐ°ÐºÐ° ÐºÐ¾Ð¶Ð¸ Ð¸ Ð² Ð¼Ð¾Ð´ÑÐ»Ðµ Ð¾ÑÐ²ÐµÑÐ° Ð½Ð° Ð²Ð¾Ð¿ÑÐ¾ÑÑ Ð¼ÐµÐ´Ð¸ÑÐ¸Ð½ÑÐºÐ¾Ð¹ Ð¿Ð¾Ð¼Ð¾ÑÐ¸, ÑÐ¸ÑÑÐµÐ¼Ð° ÑÐ¾ ÑÑÐµÐ´ÑÑÐ²Ð°Ð¼Ð¸ Ð³ÐµÐ½ÐµÑÐ°ÑÐ¸Ð¸ ÑÐ»Ð¾Ð¶Ð½ÑÑ Ð·Ð°Ð¿ÑÐ¾ÑÐ¾Ð² Ð´Ð¾ÑÑÐ¸Ð³Ð°ÐµÑ Ð·Ð°Ð¼ÐµÑÐ°ÑÐµÐ»ÑÐ½ÑÑ ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÐ¾Ð² Ð² Ð±Ð¾Ð»ÑÑÐ¸Ð½ÑÑÐ²Ðµ Ð°ÑÐ¿ÐµÐºÑÐ¾Ð², Ð¿Ð¾Ð»ÑÑÐ°Ñ Ð²ÑÑÐ¾ÐºÑÑ ÑÐ¾ÑÐ½Ð¾ÑÑÑ ÑÐ¾Ð¾ÑÐ²ÐµÑÑÑÐ²Ð¸Ñ Ð¾ÑÐ²ÐµÑÐ¾Ð² Ð¿ÑÐµÐ´Ð¾ÑÑÐ°Ð²Ð»ÐµÐ½Ð½Ð¾Ð¹ ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¾Ð¹ Ð¸Ð½ÑÐ¾ÑÐ¼Ð°ÑÐ¸Ð¸ Ð¸ Ð²ÑÑÐ¾ÐºÑÑ ÑÐ¿Ð¾ÑÐ¾Ð±Ð½Ð¾ÑÑÑ Ð¸Ð·Ð²Ð»ÐµÐºÐ°ÑÑ ÑÐ¾Ð¾ÑÐ²ÐµÑÑÑÐ²ÑÑÑÑÑ Ð¸Ð½ÑÐ¾ÑÐ¼Ð°ÑÐ¸Ñ Ð¸Ð· Ð´Ð¾ÐºÑÐ¼ÐµÐ½ÑÐ¾Ð², Ð½Ð¾, ÑÑÐ¸ÑÑÐ²Ð°Ñ Ð²ÑÑÐ¾ÐºÑÑ ÑÐ»Ð¾Ð¶Ð½Ð¾ÑÑÑ Ð²Ð¾Ð¿ÑÐ¾ÑÐ¾Ð², Ð²ÑÐµ ÐµÑÐµ Ð¿Ð¾Ð´Ð²ÐµÑÐ¶ÐµÐ½Ð° Ð³Ð°Ð»Ð»ÑÑÐ¸Ð½Ð°ÑÐ¸ÑÐ¼, Ð½Ð¾ Ð² Ð¼ÐµÐ½ÑÑÐµÐ¹ ÑÑÐµÐ¿ÐµÐ½Ð¸.
description: The topic of the graduate qualification work: âIntelligent medical system with transformer architecture and means of generating complex queriesâ. The goal of BKP: Implementation of an intelligent medical system that integrates a computer vision model for image-based diagnosis of skin cancer with medical assistance module based on means to generate complex queries that generate reliable, highly technical answers, evaluating the alignment of system outputs with medical ground truths to questions asked by specialists in oncologic dermatology. Research methods: Diagnosis of the type of skin cancer and question-answering medical assistance based on implementation of Vision Transformer architecture and means for generation of complex queries integrating Biomistral-7B LLM, naÃ¯ve retrieval augmented generation system and automatic system of question-answering evaluation using framework RAGAS in intelligent medical system. Main results of work: Intelligent medical system implemented using Python with Flask model-view-template software patterns; implementation of module for skin cancer diagnosis; implementation of module for question-answering medical assistance; implementation of module for automatic evaluation of means to generate complex queries; deployment of intelligent medical system modules using Docker. Scope of BKP results: Implementation of intelligent medical system and evaluation of performance for Vision Transformer model in diagnosis of skin cancer task and evaluation of retrieval information and answer generation quality in means to generate complex queries. Conclusions: The intelligent medical system achieve high performance and accurate results in module of diagnosis of skin cancer type and in module of question-answering medical assistance, the system with means to generation of complex queries achieve remarkable results in most of aspect, obtaining high accurate adherence of answers into technical information provided and high capacity to retrieve relevant information from documents, but given the high complexity of questions, is still subject to hallucinations, but to a lesser degree.