title: ÐÐ¸Ð·ÑÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ñ Ð°Ð½Ð°ÑÐ¾Ð¼Ð¸ÑÐµÑÐºÐ¸Ñ ÑÑÑÑÐºÑÑÑ Ð² Ð´Ð¾Ð¿Ð¾Ð»Ð½ÐµÐ½Ð½Ð¾Ð¹ ÑÐµÐ°Ð»ÑÐ½Ð¾ÑÑÐ¸
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð±Ð°ÐºÐ°Ð»Ð°Ð²ÑÐ°
titleType: Subtitle
title: Visualization of anatomical structures in augmented reality
Creators: name: Ð¡Ð¼Ð¸ÑÐ½Ð¾Ð², ÐÐ½ÑÐ¾Ð½
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2022
Subjects: Ð¼ÐµÐ´Ð¸ÑÐ¸Ð½ÑÐºÐ°Ñ Ð²Ð¸Ð·ÑÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ñ
Ð´Ð¾Ð¿Ð¾Ð»Ð½ÐµÐ½Ð½Ð°Ñ ÑÐµÐ°Ð»ÑÐ½Ð¾ÑÑÑ
Ð¾Ð±ÑÐµÐ¼Ð½ÑÐ¹ ÑÐµÐ½Ð´ÐµÑÐ¸Ð½Ð³
ÑÐ¼ÐµÑÐ°Ð½Ð½Ð°Ñ ÑÐµÐ°Ð»ÑÐ½Ð¾ÑÑÑ
ÑÐ´Ð°Ð»ÐµÐ½Ð½ÑÐ¹ ÑÐµÐ½Ð´ÐµÑÐ¸Ð½Ð³
Ð½Ð°Ð²Ð¸Ð³Ð°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ¸ÑÑÐµÐ¼Ð°
ÑÐ¸ÑÑÐµÐ¼Ñ ÐºÐ¾Ð¾ÑÐ´Ð¸Ð½Ð°Ñ
Ð³Ð¾Ð»Ð¾Ð³ÑÐ°Ð¼Ð¼Ð°
medical visualization
augmented reality
volumetric rendering
mixed reality
remote rendering
navigation system
coordinate systems
hologram

description: Ð¢ÐµÐ¼Ð° Ð²ÑÐ¿ÑÑÐºÐ½Ð¾Ð¹ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð¾Ð¹ ÑÐ°Ð±Ð¾ÑÑ: Â«ÐÐ¸Ð·ÑÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ñ Ð°Ð½Ð°ÑÐ¾Ð¼Ð¸ÑÐµÑÐºÐ¸Ñ ÑÑÑÑÐºÑÑÑ Ð² Ð´Ð¾Ð¿Ð¾Ð»Ð½ÐµÐ½Ð½Ð¾Ð¹ ÑÐµÐ°Ð»ÑÐ½Ð¾ÑÑÐ¸Â». ÐÐ°Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð¿Ð¾ÑÐ²ÑÑÐµÐ½Ð° Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ ÑÐ¿Ð¾ÑÐ¾Ð±Ð¾Ð² Ð²Ð¸Ð·ÑÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ð¸ Ð¼ÐµÐ´Ð¸ÑÐ¸Ð½ÑÐºÐ¸Ñ Ð´Ð°Ð½Ð½ÑÑ Ð² Ð´Ð¾Ð¿Ð¾Ð»Ð½ÐµÐ½Ð½Ð¾Ð¹ ÑÐµÐ°Ð»ÑÐ½Ð¾ÑÑÐ¸. ÐÐ°Ð´Ð°ÑÐ¸, ÐºÐ¾ÑÐ¾ÑÑÐµ ÑÐµÑÐ°Ð»Ð¸ÑÑ Ð² ÑÐ¾Ð´Ðµ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ: 1. ÐÐ·ÑÑÐµÐ½Ð¸Ðµ Ð²Ð¸Ð´Ð¾Ð² Ð¸ ÑÐ¿Ð¾ÑÐ¾Ð±Ð¾Ð² Ð¼ÐµÐ´Ð¸ÑÐ¸Ð½ÑÐºÐ¾Ð¹ Ð²Ð¸Ð·ÑÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ð¸. 2. ÐÐ½Ð°Ð»Ð¸Ð· ÑÑÑÐµÑÑÐ²ÑÑÑÐ¸Ñ ÑÐµÑÐ½Ð¾Ð»Ð¾Ð³Ð¸Ð¹ Ð²Ð¸ÑÑÑÐ°Ð»ÑÐ½ÑÑ Ð¿ÑÐ¾ÑÑÑÐ°Ð½ÑÑÐ². 3. Ð Ð°ÑÑÐ¼Ð¾ÑÑÐµÐ½Ð¸Ðµ Ð²Ð¾Ð·Ð¼Ð¾Ð¶Ð½Ð¾ÑÑÐµÐ¹ Ð¾Ð±ÑÐµÐ¼Ð½Ð¾Ð¹ Ð²Ð¸Ð·ÑÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ð¸ Ð´Ð°Ð½Ð½ÑÑ. 4. ÐÑÐ¾ÐµÐºÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ðµ ÑÐ¿Ð¾ÑÐ¾Ð±Ð¾Ð² Ð¾Ð±ÑÐµÐ´Ð¸Ð½ÐµÐ½Ð¸Ñ ÑÐ¸ÑÑÐµÐ¼ HoloLens 2 Ð¸ HTC Vive. 5. ÐÑÑÐ¸ÑÐ»ÐµÐ½Ð¸Ðµ ÑÐ¾ÑÐ½Ð¾ÑÑÐ¸ Ð¸ Ð¾Ð¿ÑÐ¸Ð¼Ð¸Ð·Ð°ÑÐ¸Ð¸ Ð¿ÑÐµÐ´Ð»Ð°Ð³Ð°ÐµÐ¼ÑÑ Ð¼ÐµÑÐ¾Ð´Ð¾Ð². 6. Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° Ð¿ÑÐ¸Ð»Ð¾Ð¶ÐµÐ½Ð¸Ñ Ð½Ð° Ð±Ð°Ð·Ðµ Unity Ñ Ð²ÑÐ±ÑÐ°Ð½Ð½ÑÐ¼ Ð¼ÐµÑÐ¾Ð´Ð¾Ð¼. Ð Ð´Ð°Ð½Ð½Ð¾Ð¹ ÑÐ°Ð±Ð¾ÑÐµ Ð±ÑÐ»Ð¾ Ð¿ÑÐ¾Ð²ÐµÐ´ÐµÐ½Ð¾ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ðµ Ð¾ ÑÐ¿Ð¾ÑÐ¾Ð±Ð°Ñ Ð²Ð¸Ð·ÑÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ð¸ Ð°Ð½Ð°ÑÐ¾Ð¼Ð¸Ð¸ ÑÐµÐ»Ð¾Ð²ÐµÐºÐ° Ñ Ð¿Ð¾Ð¼Ð¾ÑÑÑ, Ð´Ð°Ð½Ð½ÑÑ, Ð¿Ð¾Ð»ÑÑÐµÐ½Ð½ÑÑ ÑÐµÑÐµÐ· ÐÐ Ð¢ Ð¸ ÐÐ¢. ÐÑÐ½Ð¾Ð²Ð½ÑÐ¼ Ð¿Ð¾Ð´ÑÐ¾Ð´Ð¾Ð¼ Ð²Ð¸Ð·ÑÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ð¸ Ð±ÑÐ» Ð²ÑÐ±ÑÐ°Ð½ Ð¾Ð±ÑÐµÐ¼Ð½ÑÐ¹ ÑÐµÐ½Ð´ÐµÑÐ¸Ð½Ð³. ÐÑÐ»Ð¸ ÑÐ°ÑÑÐ¼Ð¾ÑÑÐµÐ½Ñ ÐµÐ³Ð¾ Ð¿ÑÐµÐ¸Ð¼ÑÑÐµÑÑÐ²Ð° Ð¸ Ð²Ð¾Ð·Ð¼Ð¾Ð¶Ð½ÑÐµ ÑÐ»Ð¾Ð¶Ð½Ð¾ÑÑÐ¸ Ð² Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð¸Ð¸. Ð ÑÐ¾Ð´Ðµ Ð°Ð½Ð°Ð»Ð¸Ð·Ð° ÑÑÐ½ÐºÐ° ÑÑÑÐµÑÑÐ²ÑÑÑÐ¸Ñ ÑÑÑÑÐ¾Ð¹ÑÑÐ² Ð´Ð¾Ð¿Ð¾Ð»Ð½ÐµÐ½Ð½Ð¾Ð¹ Ð¸ Ð²Ð¸ÑÑÑÐ°Ð»ÑÐ½Ð¾Ð¹ ÑÐµÐ°Ð»ÑÐ½Ð¾ÑÑÐ¸, Ð±ÑÐ»Ð¸ Ð²ÑÐ±ÑÐ°Ð½Ñ Ð¾ÑÐºÐ¸ HoloLens. ÐÑÐ¸ Ð°Ð½Ð°Ð»Ð¸Ð·Ðµ ÑÑÐ½ÐºÐ° Ð¼ÐµÐ´Ð¸ÑÐ¸Ð½ÑÐºÐ¸Ñ Ð½Ð°Ð²Ð¸Ð³Ð°ÑÐ¸Ð¾Ð½Ð½ÑÑ ÑÐ¸ÑÑÐµÐ¼, Ð°Ð»ÑÑÐµÑÐ½Ð°ÑÐ¸Ð²Ð¾Ð¹ Ð¿ÑÐµÐ´Ð»Ð¾Ð¶ÐµÐ½Ð° ÑÐ¸ÑÑÐµÐ¼Ð° ÑÐ»ÐµÐ¶ÐµÐ½Ð¸Ñ Ð½Ð° Ð±Ð°Ð·Ðµ ÐÐ-ÑÑÐ°Ð½ÑÐ¸Ð¹ Vive. Ð ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÐµ Ð±ÑÐ»Ð¸ Ð¿ÑÐµÐ´Ð»Ð¾Ð¶ÐµÐ½Ñ 2 ÑÐ¿Ð¾ÑÐ¾Ð±Ð° Ð¾Ð±ÑÐµÐ´Ð¸Ð½ÐµÐ½Ð¸Ñ ÑÐ¸ÑÑÐµÐ¼ ÐºÐ¾Ð¾ÑÐ´Ð¸Ð½Ð°Ñ HoloLens 2 Ð¸ HTC Vive. ÐÐ¸Ð½Ð¸Ð¼Ð°Ð»ÑÐ½ÑÑ Ð¿Ð¾Ð³ÑÐµÑÐ½Ð¾ÑÑÑ Ð¿Ð¾ÐºÐ°Ð·Ð°Ð» Ð²ÑÐ¾ÑÐ¾Ð¹ Ð²Ð°ÑÐ¸Ð°Ð½Ñ. Ð¢Ð°Ðº Ð¶Ðµ ÑÑÐ°Ð²Ð½Ð¸Ð²Ð°Ð»Ð°ÑÑ Ð¾Ð¿ÑÐ¸Ð¼Ð¸Ð·Ð°ÑÐ¸Ñ Ð¾Ð±ÑÐµÐ¼Ð½Ð¾Ð³Ð¾ ÑÐµÐ½Ð´ÐµÑÐ¸Ð½Ð³Ð° Ñ Ð¿Ð¾Ð¼Ð¾ÑÑÑ ÑÐ´Ð°Ð»ÐµÐ½Ð½Ð¾Ð³Ð¾ ÑÐµÐ½Ð´ÐµÑÐ¸Ð½Ð³Ð°. ÐÐ° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð¿ÑÐ¾Ð²ÐµÐ´ÐµÐ½Ð½ÑÑ Ð¾Ð¿ÑÑÐ¾Ð² Ð±ÑÐ»Ð¾ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½Ð¾ Ð¸ Ð¿ÑÐ¾ÑÐµÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¾ Ð¿ÑÐ¸Ð»Ð¾Ð¶ÐµÐ½Ð¸Ðµ.
description: The theme of the final qualification work: "Visualization of anatomical structures in augmented reality." This work is devoted to the study of ways to visualize medical data in augmented reality. Tasks that were solved in the course of the study: 1. Studying the types and methods of medical imaging. 2. Analysis of existing technologies for interaction with virtual space. 3. Consideration of the possibilities of volumetric data visualization. 4. Designing ways to integrate HoloLens 2 and HTC Vive. 5. Calculation of the accuracy and optimization of the proposed methods. 6. Development of an application based on Unity using the selected methods. In this work, a study was conducted on ways to visualize human anatomy using data obtained through MRI and CT. Volumetric rendering was chosen as the main visualization approach. Its advantages and possible difficulties in use were considered. During the market analysis of existing augmented and virtual reality devices, HoloLens glasses were chosen. When analyzing the medical navigation systems market, a tracking system based on Vive IR stations was proposed as an alternative. As a result, 2 ways were proposed to combine the coordinate systems of HoloLens 2 and HTC Vive. The second option showed the minimum error. We also compared optimization of volumetric rendering using remote rendering. Based on the experiments, an application was developed and tested.