# Presentation: 694726

## Wireless Augmented Reality Prototype

- Developed by NASA/Jet Propulsion Laboratory
- For Information Contact:  Ann Devereaux, JPL / MS 238-420, 4800 Oak Grove Dr, Pasadena, CA 91109
- Email: ann.devereaux@jpl.nasa.gov   Ph: 818 354 514
- http://www331.jpl.nasa.gov/public/warp

## WIRELESS AUGMENTED REALITY PROTOTYPE

**PROGRAM:**
**Develop wireless remote information access and teleconferencing unit for use in a space habitat or other environment**
**2-way color video**
**Personal display of remote computer screen or other video source**
**2-way audio**
**Voice activation of base station computer**
**Biosensor or other sensor data return**
**3 phase program, Phase II complete, Phase III beginning**
**Sponsored by Code UL(NASA HQ), Code M (NASA/JSC)**

**APPLICATIONS:**
**Control at a Distance - monitor and control of computer-controlled equipment,  robotic cameras or manipulators**
**Hazardous Confinement - bio-isolation suits, EVA suits: info retrieval and user health and situational monitoring **
**Telemedicine**
**Remote Consultation - inspection or maintenance crews in remote or dangerous environments**
**Operations - mission control and other operations console personnel**
**Wireless Sensor Nets -  WARP remote access units (RAUs) can be used as wireless sensor packages, allowing multiple wireless sensors to be placed and removed as needed throughout an extended area which has had WARP network nodes previously installed**

## WARP Phase II System 

- WARP Phase II System

**Features:**
**color display**
**color camera**
**microphone and speaker**
**port for interchangeable headset **
**port for interchangeable sensor **
**2-hr battery pack**
**optional integrated touchpad for computer control**

**Standard PC with 2 installed PCI cards and Interface Unit**
**Features:**
**Voice or mouse activation**
**Full features of standard PC including**
**ethernet, teleconferencing, web browsing, document recall, etc**

_**Remote Access Unit (RAU) **_
_**and Headset**_

_**Base Station**_

## WARP TECHNOLOGY

**STATE OF THE ART: does not exist (WARP concept patent application submitted)**
**Wearable computers:  bulky, power-limited, constrained by on-board storage capacity and low-performance wireless access, if any**
**Wireless sensors: typically bulky and power-constrained and/or analog with poor data return and networking capability**
** **
**WARP Phase II Technology Infusion**
**Headset display user trials through partner NASA/ARC**
**Development of new headset optics**
**Headset ergonomic improvements based on human testing evaluations**
**Biosensor development at NASA/ARC for WARP integration**
**Development of flight mission scenarios at NASA/JSC**
**Modifications to system for user-specific applications (ARC partner)**
**JSC developing mission and flight test plans**
**Integration of WARP Phase II into JSC-commissioned “Procedure Assistant” -- automated checklist tool now using laptop PCs (S&K Electronics)**
**Integration of WARP Phase II into Southwest Research Institute “Lifelink” program (2-way conferencing between hospitals and ambulances).  Joint demo scheduled for 8/99 **
**Integration of WARP into NASA telemedicine system with Loma Linda University**
**Demonstration of WARP with NSBRI (UT Houston, Texas A&M)**
**Proposal of development of true augmented reality application (transparent information overlay) for ISS**
**Commercial licensing to be pursued by Caltech for Phase II concept, Phase III production **

## WARP PHASE III DEVELOPMENT

**Phase III commencing in conjunction with Phase II demonstration and user/flight testing cycle (Jun 99 - continuing)**
**Next-generation color VGA and SVGA displays (now becoming available) and human-engineered headset design**
**Full custom chips and layout, allowing large size and power reductions for Remote Access Units along with inherently greater flexibility for different applications**
**FPGA/ASIC-based radio leveraged off of JPL receiver-on-a-chip radio development**
**Custom codec circuit based on Phase II codec development**
**Digital video circuit integration using active-pixel-sensor camera development**
**Multiple access system supporting multiple users in one module**
**Intra-system audio/video/data sharing between individual users**
**Station-wide audio communications across different zones**
**Seamless link into wired infrastructure for personal comms or wireless sensors**
**Cellular network model allowing WARP remote units to be mobile throughout extended areas covered by WARP interface modules**
**Extension of WARP RAU concept into non-personal wireless sensor platforms capable of supporting various sensor heads (video, biological, chemical, etc.), which plug and play into WARP wireless network structure**
**Phase III prototype units projected available Spring ‘02**