{"id":96416,"date":"2022-04-08T15:00:00","date_gmt":"2022-04-08T19:00:00","guid":{"rendered":"https:\/\/www.nasa.gov\/?migration=converted-node-478705"},"modified":"2023-07-26T16:36:53","modified_gmt":"2023-07-26T20:36:53","slug":"innovative-3d-telemedicine-to-help-keep-astronauts-healthy","status":"publish","type":"post","link":"https:\/\/www.nasa.gov\/humans-in-space\/innovative-3d-telemedicine-to-help-keep-astronauts-healthy\/","title":{"rendered":"Innovative 3D Telemedicine to Help Keep Astronauts Healthy"},"content":{"rendered":"<div id=\"\" class=\"hds-media hds-module wp-block-image\"><div class=\"margin-left-auto margin-right-auto nasa-block-align-inline\"><div class=\"hds-media-wrapper margin-left-auto margin-right-auto\"><figure class=\"hds-media-inner hds-cover-wrapper hds-media-ratio-none \"><a href=\"https:\/\/www.nasa.gov\/wp-content\/uploads\/2022\/04\/20211008_062354_hololens_first_image.jpg\"><img fetchpriority=\"high\" decoding=\"async\" width=\"1408\" height=\"792\" src=\"https:\/\/www.nasa.gov\/wp-content\/uploads\/2022\/04\/20211008_062354_hololens_first_image.jpg?w=1408\" class=\"attachment-2048x2048 size-2048x2048\" alt=\"NASA flight surgeon, Dr. Josef Schmid gives a space greeting Oct. 8, 2021, as he is holoported on to the International Space Station.\" style=\"transform: scale(1); transform-origin: 50% 50%; object-position: 50% 50%; object-fit: cover;\" block_context=\"nasa-block\" srcset=\"https:\/\/www.nasa.gov\/wp-content\/uploads\/2022\/04\/20211008_062354_hololens_first_image.jpg 1408w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2022\/04\/20211008_062354_hololens_first_image.jpg?resize=300,169 300w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2022\/04\/20211008_062354_hololens_first_image.jpg?resize=768,432 768w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2022\/04\/20211008_062354_hololens_first_image.jpg?resize=1024,576 1024w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2022\/04\/20211008_062354_hololens_first_image.jpg?resize=400,225 400w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2022\/04\/20211008_062354_hololens_first_image.jpg?resize=600,338 600w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2022\/04\/20211008_062354_hololens_first_image.jpg?resize=900,506 900w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2022\/04\/20211008_062354_hololens_first_image.jpg?resize=1200,675 1200w\" sizes=\"(max-width: 1408px) 100vw, 1408px\" loading=\"eager\" \/><\/a><\/figure><figcaption class=\"hds-caption padding-y-2\"><div class=\"hds-caption-text p-sm margin-0\">NASA flight surgeon, Dr. Josef Schmid gives a space greeting Oct. 8, 2021, as he is holoported on to the International Space Station.<\/div><div class=\"hds-credits\"><strong><em>ESA (European Space Agency) astronaut Thomas Pesquet<\/em><\/strong><\/div><\/figcaption><\/div><\/div><\/div>\n\n\n<p>During almost two-years of the COVID-19 pandemic, the growth of telemedicine and new ways of reaching people has changed and developed. In October 2021, NASA flight surgeon Dr. Josef Schmid, industry partner AEXA Aerospace CEO Fernando De La Pena Llaca, and their teams were the first humans \u201choloported\u201d from Earth into space.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>Using the Microsoft Hololens Kinect camera and a personal computer with custom software from Aexa, ESA (European Space Agency) astronaut Thomas Pesquet had a two-way conversation with live images of Schmid and De La Pena placed in the middle of the International Space Station. This was the first holoportation handshake from Earth in space.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>Holoportation is a type of capture technology that allows high-quality 3D models of people to be reconstructed, compressed and transmitted live anywhere in real time, Schmid said. When combined with mixed reality displays such as HoloLens, it allows users to see, hear, and interact with remote participants in 3D as if they are actually present in the same physical space. \u00a0Holoportation has been in use since at least 2016 by Microsoft, but this is the first use in such an extreme and remote environment such as space.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>\u201cThis is completely new manner of human communication across vast distances,\u201d Schmid said. \u201cFurthermore, it is a brand-new way of human exploration, where our human entity is able to travel off the planet. Our physical body is not there, but our human entity absolutely is there.\u00a0It doesn\u2019t matter that the space station is traveling 17,500 mph and in constant motion in orbit 250 miles above Earth, the astronaut can come back three minutes or three weeks later and with the system running, we will be there in that spot, live on the space station.\u201d<\/p>\n\n\n\n<p><\/p>\n\n\n<div id=\"\" class=\"hds-media hds-module wp-block-image\"><div class=\"margin-left-auto margin-right-auto nasa-block-align-inline\"><div class=\"hds-media-wrapper margin-left-auto margin-right-auto\"><figure class=\"hds-media-inner hds-cover-wrapper hds-media-ratio-none \"><a href=\"https:\/\/www.nasa.gov\/wp-content\/uploads\/2022\/04\/20211008_062445_hololens_whole_team-1.jpg\"><img loading=\"lazy\" decoding=\"async\" width=\"1408\" height=\"792\" src=\"https:\/\/www.nasa.gov\/wp-content\/uploads\/2022\/04\/20211008_062445_hololens_whole_team-1.jpg?w=1408\" class=\"attachment-2048x2048 size-2048x2048\" alt=\"Holoportation team members are seen projected virtually on the International Space Station, Oct. 8, 2021.\" style=\"transform: scale(1); transform-origin: 50% 50%; object-position: 50% 50%; object-fit: cover;\" block_context=\"nasa-block\" srcset=\"https:\/\/www.nasa.gov\/wp-content\/uploads\/2022\/04\/20211008_062445_hololens_whole_team-1.jpg 1408w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2022\/04\/20211008_062445_hololens_whole_team-1.jpg?resize=300,169 300w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2022\/04\/20211008_062445_hololens_whole_team-1.jpg?resize=768,432 768w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2022\/04\/20211008_062445_hololens_whole_team-1.jpg?resize=1024,576 1024w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2022\/04\/20211008_062445_hololens_whole_team-1.jpg?resize=400,225 400w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2022\/04\/20211008_062445_hololens_whole_team-1.jpg?resize=600,338 600w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2022\/04\/20211008_062445_hololens_whole_team-1.jpg?resize=900,506 900w, https:\/\/www.nasa.gov\/wp-content\/uploads\/2022\/04\/20211008_062445_hololens_whole_team-1.jpg?resize=1200,675 1200w\" sizes=\"(max-width: 1408px) 100vw, 1408px\" \/><\/a><\/figure><figcaption class=\"hds-caption padding-y-2\"><div class=\"hds-caption-text p-sm margin-0\">Holoportation team members are seen projected virtually on the International Space Station, Oct. 8, 2021. From left are Andrew Madrid, Dr. Fernando De La Pena Llaca, RIhab Sadik, Dr. Joe Schmid, Kevin Bryant, Mackenzie Hoffman, Wes Tarkington.<\/div><div class=\"hds-credits\"><strong><em>ESA (European Space Agency) astronaut Thomas Pesquet<\/em><\/strong><\/div><\/figcaption><\/div><\/div><\/div>\n\n\n<p>NASA is demonstrating this new form of communication as a precursor for more extensive use on future missions. Plans are to use this next with two-way communication, where people on Earth are holoported to space and astronauts are placed back on earth. \u201cWe\u2019ll use this for our private medical conferences, private psychiatric conferences, private family conferences and to bring VIPs onto the space station to visit with astronauts.\u201d<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>The next step after that is to combine holoportation with augmented reality, to truly enable Tele-mentoring.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>\u201cImagine you can bring the best instructor or the actual designer of a particularly complex technology right beside you wherever you might be working on it. Furthermore, we will combine augmented reality with haptics. You can work on the device together, much like two of the best surgeons working during an operation. This would put everyone at rest knowing the best team is working together on a critical piece of hardware,\u201d Schmid said.\u00a0 \u00a0<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>Holoportation and tools like it could have great implications on the future of deep space travel. As plans shape up for missions to Mars, an obstacle to overcome will be the communication delays that are present during the travel to and from Mars. A delay of up to 20 minutes each way will present a unique challenge to communication whether through simple radio transmissions, video streams or new methods such as Holoportation. <\/p>\n\n\n\n<p>Communication is critical, whether for medical or mission support reasons, or staying in touch with family members. The crew will need to be connected with Earth and Mission Control, no matter where humans explore.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>There are also direct applications here on Earth. Whether in other extreme environments such as Antarctica, offshore oil rigs or military operation theaters, this type of technology may help people in such situations communicate, bringing people together no matter the distance or environmental challenges.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>During almost two-years of the COVID-19 pandemic, the growth of telemedicine and new ways of reaching people has changed and developed. In October 2021, NASA flight surgeon Dr. Josef Schmid, industry partner AEXA Aerospace CEO Fernando De La Pena Llaca, and their teams were the first humans \u201choloported\u201d from Earth into space. Using the Microsoft […]<\/p>\n","protected":false},"author":133,"featured_media":100107,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"nasa_hds_core_meta_l10n":"en-US","nasa_hds_core_meta_article_editor":"","nasa_hds_core_meta_article_contacts":[],"nasa_hds_core_meta_article_topic":"","nasa_hds_core_meta_linked_locations":[],"nasa_hds_core_meta_article_related_articles":[],"hds_migrate_meta_pr_release_id":"","hds_migrate_meta_pr_release_type":"","nasa_hds_core_meta_location_x":"","nasa_hds_core_meta_location_y":"","nasa_hds_core_meta_gallery_images":[],"footnotes":""},"categories":[8372,2656,2735],"news-tags":[],"internal-terms":[11379,11270,12008],"coauthors":[],"parsely":{"version":"1.1.0","meta":{"@context":"https:\/\/schema.org","@type":"NewsArticle","headline":"Innovative 3D Telemedicine to Help Keep Astronauts Healthy","url":"https:\/\/www.nasa.gov\/humans-in-space\/innovative-3d-telemedicine-to-help-keep-astronauts-healthy\/","mainEntityOfPage":{"@type":"WebPage","@id":"https:\/\/www.nasa.gov\/humans-in-space\/innovative-3d-telemedicine-to-help-keep-astronauts-healthy\/"},"thumbnailUrl":"https:\/\/www.nasa.gov\/wp-content\/uploads\/2022\/04\/20211008_062354_hololens_first_image.jpg?w=150&h=150&crop=1","image":{"@type":"ImageObject","url":"https:\/\/www.nasa.gov\/wp-content\/uploads\/2022\/04\/20211008_062354_hololens_first_image.jpg"},"articleSection":"Missions","author":[{"@type":"Person","name":"Mark A. Garcia"}],"creator":["Mark A. Garcia"],"publisher":{"@type":"Organization","name":"NASA","logo":"https:\/\/www.nasa.gov\/wp-content\/themes\/nasa\/assets\/images\/nasa-logo.svg"},"keywords":["Missions","International Space Station (ISS)","Expedition 66","Humans in Space"],"dateCreated":"2022-04-08T19:00:00Z","datePublished":"2022-04-08T19:00:00Z","dateModified":"2023-07-26T20:36:53Z"},"rendered":"<meta name=\"parsely-title\" content=\"Innovative 3D Telemedicine to Help Keep Astronauts Healthy\" \/>\n<meta name=\"parsely-link\" content=\"https:\/\/www.nasa.gov\/humans-in-space\/innovative-3d-telemedicine-to-help-keep-astronauts-healthy\/\" \/>\n<meta name=\"parsely-type\" content=\"post\" \/>\n<meta name=\"parsely-image-url\" content=\"https:\/\/www.nasa.gov\/wp-content\/uploads\/2022\/04\/20211008_062354_hololens_first_image.jpg?w=150&h=150&crop=1\" \/>\n<meta name=\"parsely-pub-date\" content=\"2022-04-08T19:00:00Z\" \/>\n<meta name=\"parsely-section\" content=\"Missions\" \/>\n<meta name=\"parsely-tags\" content=\"Missions,International Space Station (ISS),Expedition 66,Humans in Space\" \/>\n<meta name=\"parsely-author\" content=\"Mark A. Garcia\" \/>","tracker_url":"https:\/\/cdn.parsely.com\/keys\/nasa.gov\/p.js"},"read_time":3,"time_ago":"2 years","featured_image":{"id":100107,"file":"https:\/\/www.nasa.gov\/wp-content\/uploads\/2022\/04\/20211008_062354_hololens_first_image.jpg","title":"20211008_062354_hololens_first_image","alt":"NASA flight surgeon, Dr. Josef Schmid gives a space greeting Oct. 8, 2021, as he is holoported on to the International Space Station.","caption":""},"_links":{"self":[{"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/posts\/96416"}],"collection":[{"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/users\/133"}],"replies":[{"embeddable":true,"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/comments?post=96416"}],"version-history":[{"count":3,"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/posts\/96416\/revisions"}],"predecessor-version":[{"id":367927,"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/posts\/96416\/revisions\/367927"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/media\/100107"}],"wp:attachment":[{"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/media?parent=96416"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/categories?post=96416"},{"taxonomy":"news-tags","embeddable":true,"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/news-tags?post=96416"},{"taxonomy":"internal-terms","embeddable":true,"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/internal-terms?post=96416"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.nasa.gov\/wp-json\/wp\/v2\/coauthors?post=96416"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}