Source: https://patents.google.com/patent/US8520024B2/en
Timestamp: 2020-01-19 16:50:16
Document Index: 213480816

Matched Legal Cases: ['Application No. 20080826034', 'Application No. 20080826034', 'Application No. 2010', 'Application No. 2010', 'Application No. 20080826034', 'Application No. 20080826034', 'Application No. 20080826034', 'Application No. 20080826034', 'Application No. 08826034', 'Application No. 2008826034', 'Application No. 2008826034', 'Application No. 582133', 'Application No. 582133', 'Application No. 582133', 'Application No. 582133', 'Application No. 2008270883', 'Application No. 2008270883', 'Application No. 2010', 'Application No. 2010', 'Application No. 2008800243237', 'Application No. 2008800243237', 'Application No. 20080826034', 'Application No. 20080826034', 'Application No. 2010', 'Application No. 2010', 'Application No. 2008800243237', 'Application No. 2008800243237', 'Application No. 2010', 'Application No. 2010', 'Application No. 2010', 'Application No. 2010', 'Application No. 2008270883', 'Application No. 2008270883', 'Application No. 2008270883', 'Application No. 2008270883', 'Application No. 20080826034', 'Application No. 20080826034', 'Application No. 08826034', 'Application No. 08826034', 'Application No. 582133', 'Application No. 582133', 'Application No. 2008800243237', 'Application No. 2008800243237', 'Application No. 2010', 'Application No. 2010', 'Application No. 2008270883', 'Application No. 2008270883', 'Application No. 2008800243237', 'Application No. 2008800243237', 'Application No. 2008800243237', 'Application No. 2008800243237', 'Application No. 2008800243237', 'Application No. 2008800243237', 'Application No. 2010', 'Application No. 2010']

US8520024B2 - Virtual interactive presence systems and methods - Google Patents
Virtual interactive presence systems and methods Download PDF
US8520024B2
US8520024B2 US12/600,805 US60080508A US8520024B2 US 8520024 B2 US8520024 B2 US 8520024B2 US 60080508 A US60080508 A US 60080508A US 8520024 B2 US8520024 B2 US 8520024B2
US12/600,805
US20100295921A1 (en
Phillip C. Shum
2008-05-19 Application filed by University of Alabama at Birmingham Research Foundation filed Critical University of Alabama at Birmingham Research Foundation
2008-05-19 Priority to US12/600,805 priority patent/US8520024B2/en
2010-11-25 Publication of US20100295921A1 publication Critical patent/US20100295921A1/en
2013-07-29 Assigned to UAB RESEARCH FOUNDATION reassignment UAB RESEARCH FOUNDATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: GUTHRIE, BARTON, DILLAVOU, MARCUS W., SHUM, PHILLIP C., SHIH, ALAN M.
2013-08-27 Publication of US8520024B2 publication Critical patent/US8520024B2/en
2013-12-17 Assigned to UAB RESEARCH FOUNDATION reassignment UAB RESEARCH FOUNDATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ROSS, DOUGLAS H.
2019-06-13 Assigned to UNITED STATES DEPARTMENT OF ENERGY reassignment UNITED STATES DEPARTMENT OF ENERGY CONFIRMATORY LICENSE (SEE DOCUMENT FOR DETAILS). Assignors: UNIVERSITY OF ALABAMA AT BIRMINGHAM
rendering interaction between the physical presence of the remote user and the physical presence of the local user in the common field of interest substantially as if the remote user and the local user were physically proximate and physically interacting in real time; and
continuously updating the common field of interest such that the physical presence of the remote user is rendered in real time to the local user and the physical presence of the local user is rendered in real time to the remote user, wherein the updated common field of interest is configured to reflect merged, real-time movement of the physical presence of the remote user and the physical presence of the local user.
rendering interaction between the local object, the volumetric image, and the local user in the local field of interest substantially as if the local object, the volumetric image, and the local user were physically proximate and physically interacting in real time; and
rendering interaction between the physical presence of the remote user and the physical presence of the local user in the common field of interest substantially as if the remote user and the local user were physically proximate and physically interacting in real time;
continuously updating the common field of interest such that the physical presence of the remote user is rendered in real time to the local user and the physical presence of the local user is rendered in real time to the remote user, wherein the updated common field of interest reflects the merged, real-time movement of the physical presence of the remote user and the physical presence of the local user; and
outputting the common field of interest to the virtual presence display such that the local user and the remote user can perceive the merged, real-time movement of the physical presence of the remote user and the physical presence of the local user via the virtual presence display.
19. The system of claim 14 or 17, wherein the processor is further configured to perform steps comprising:
20. The system of claim 14, wherein the processor is further configured to perform steps comprising:
a processor, coupled to the virtual presence display and the local sensor,
wherein the processor is configured to perform steps comprising,
rendering interaction between the local object, the volumetric image, and the local user in the local field of interest substantially as if the local object, the volumetric image, and the local user were physically proximate and physically interacting in real time;
US12/600,805 2007-05-18 2008-05-19 Virtual interactive presence systems and methods Active 2030-02-19 US8520024B2 (en)
US12/600,805 US8520024B2 (en) 2007-05-18 2008-05-19 Virtual interactive presence systems and methods
US20100295921A1 US20100295921A1 (en) 2010-11-25
US8520024B2 true US8520024B2 (en) 2013-08-27
US12/600,805 Active 2030-02-19 US8520024B2 (en) 2007-05-18 2008-05-19 Virtual interactive presence systems and methods
JP5939733B2 (en) 2010-10-15 2016-06-22 任天堂株式会社 Image processing program, image processing apparatus, image processing system, and image processing method
US9491418B2 (en) * 2012-11-15 2016-11-08 Steen Svendstorp Iversen Method of providing a digitally represented visual instruction from a specialist to a user in need of said visual instruction, and a system therefor
Ai, et al. "Tele-immersive medical educational environment," University of Illinois at Chicago. VRMedLab, School of Biomedical and Health Information Sciences: p. 1-7.
Amendments filed Apr. 4, 2012 to the European Patent Office for Application No. 20080826034, filed May 19, 2008 (Applicant-UAB Research Foundation; Inventor-Guthrie, et al.;) (p. 1-10).
Amendments filed Apr. 4, 2012 to the European Patent Office for Application No. 20080826034, filed May 19, 2008 (Applicant—UAB Research Foundation; Inventor—Guthrie, et al.;) (p. 1-10).
Appeal Brief filed Mar. 25, 2013 for Application No. 2010-508631, filed May 19, 2008 (Applicant-UAB Research Foundation; Inventor -Guthrie, et al.;) (p. 1-8).
Appeal Brief filed Mar. 25, 2013 for Application No. 2010-508631, filed May 19, 2008 (Applicant—UAB Research Foundation; Inventor —Guthrie, et al.;) (p. 1-8).
Ballantyne, et al. "The da vinci telerobotic surgical systems: the virtual operative field and telepresence surgery" Surg Clin North Am. 2003, 83 (6): p. 1293-1304.
Billinghurst et al., "Mixing realities in Shared Spaces: An augmented reality interface for collaborative computing," Multimedia and Expo, 2000. ICME 2000 IEEE International Conference CE on New York, Jul. 30, 2000-Aug. 2, 2000, vol. 3. 1641-1644. Jul. 30, 2000.
Billinghurst, et al. "Real world teleconferencing," IEEE Computer Graphics 2002, 22(6): p. 11-13.
Communication from the Examining Division issued Jun. 8, 2012 by the European Patent Office for Application No. 20080826034, filed May 19, 2008 (Applicant-UAB Reserach Foundation; Inventor-Guthrie, et al.;) (p. 1-8).
Communication from the Examining Division issued Jun. 8, 2012 by the European Patent Office for Application No. 20080826034, filed May 19, 2008 (Applicant—UAB Reserach Foundation; Inventor—Guthrie, et al.;) (p. 1-8).
Communication Regarding Possible Amendments of Claims issued Jan. 13, 2010 by the European Patent Office for Application No. 20080826034, filed May 19, 2008 (Applicant-UAB Research Foundation; Inventor-Guthrie, et al.;) (p. 1-2).
Communication Regarding Possible Amendments of Claims issued Jan. 13, 2010 by the European Patent Office for Application No. 20080826034, filed May 19, 2008 (Applicant—UAB Research Foundation; Inventor—Guthrie, et al.;) (p. 1-2).
Dangelmaier et al., "Virtual and augmented reality support for discrete manufacturing system simulation," Computers in Industry, vol. 56, No. 4, May 1, 2005.
European Search Report for European Application No. 08826034.4 filed on May 19, 2008.
European Search Report issued on Sep. 15, 2011 by the European Patent Office for Application No. 2008826034, filed May 19, 2008 (Applicant-UAB Research Foundations; Inventor-Barton Guthrie;) (p. 1-9).
European Search Report issued on Sep. 15, 2011 by the European Patent Office for Application No. 2008826034, filed May 19, 2008 (Applicant—UAB Research Foundations; Inventor—Barton Guthrie;) (p. 1-9).
Examination Report and Notice of Acceptance issued Dec. 3, 2012 by the New Zealand Intellectual Property Office for Application No. 582133, filed May 19, 2008 (Applicant-UAB Research Foundation; Inventor-Guthrie, et al.;) (p. 1-1).
Examination Report and Notice of Acceptance issued Dec. 3, 2012 by the New Zealand Intellectual Property Office for Application No. 582133, filed May 19, 2008 (Applicant—UAB Research Foundation; Inventor—Guthrie, et al.;) (p. 1-1).
Examination Report issued May 3, 2011 by the New Zealand Intellectual Property Office for Application No. 582133, filed May 19, 2008 (Applicant-UAB Research Foundation; Inventor-Guthrie, et al.;) (p. 1-2).
Examination Report issued May 3, 2011 by the New Zealand Intellectual Property Office for Application No. 582133, filed May 19, 2008 (Applicant—UAB Research Foundation; Inventor—Guthrie, et al.;) (p. 1-2).
Examiner's First Report issued Mar. 29, 2012 by IP Australia for Application No. 2008270883, filed May 19, 2008 (Applicant-UAB Research Foundation; Inventor-Guthrie, et al.;) (p. 1-2).
Examiner's First Report issued Mar. 29, 2012 by IP Australia for Application No. 2008270883, filed May 19, 2008 (Applicant—UAB Research Foundation; Inventor—Guthrie, et al.;) (p. 1-2).
Final Office Action issued Oct. 12, 2012 for Application No. 2010-508631, filed May 19, 2008 (Applicant-UAB Research Foundation; Inventor-Guthrie, et al.;) (p. 1-2).
Final Office Action issued Oct. 12, 2012 for Application No. 2010-508631, filed May 19, 2008 (Applicant—UAB Research Foundation; Inventor—Guthrie, et al.;) (p. 1-2).
First Office Action issued Jun. 23, 2011 by the State Intellectual Property Office of the People's Republic of China for Application No. 2008800243237, filed May 19, 2080 (Applicant-UAB Research Foundation; Inventor-Guthrie, et al.;) (p. 1-68).
First Office Action issued Jun. 23, 2011 by the State Intellectual Property Office of the People's Republic of China for Application No. 2008800243237, filed May 19, 2080 (Applicant—UAB Research Foundation; Inventor—Guthrie, et al.;) (p. 1-68).
Gibson, et al. "Simulating arthroscopic knee surgery using volumetric object representations, real-time volume rendering and haptic feedback," Proceedings of CVRMed-MRCAS 1997: p. 369-378.
Haluck, et al. Reliability and validity of endotower, a virtual reality trainer for angled endoscope navigation. J.D. Westwood et al. (Eds), Meidcine Meets Virtual Reality 2002, IOS Press: p. 1-6.
International Search Report and Written Opinion issued on Oct. 16, 2012 by the International Searching Authority for Application No. PCT/US12/50238, filed Aug. 10, 2012 (Applicant-VIPAAR, LLC; Inventor-Marcus W. Dillavou;) (p. 1-7).
International Search Report and Written Opinion issued on Oct. 16, 2012 by the International Searching Authority for Application No. PCT/US12/50238, filed Aug. 10, 2012 (Applicant—VIPAAR, LLC; Inventor—Marcus W. Dillavou;) (p. 1-7).
Invitation Pursuant to Rule 62a(1) issued May 16, 2011 by the European Patent Office for Application No. 20080826034, filed May 19, 2008 (Applicant-UAB Research Foundation; Inventor-Guthrie, et al,;) (p. 1-2).
Invitation Pursuant to Rule 62a(1) issued May 16, 2011 by the European Patent Office for Application No. 20080826034, filed May 19, 2008 (Applicant—UAB Research Foundation; Inventor—Guthrie, et al,;) (p. 1-2).
Nicolau, et al. "An augmented reality system to guide radio-frequency tumour ablation," Computer Animation and Virtual World (previously the Journal of Visualization & Computer Animation) 2004, 16 (1): p. 1-10, 200.
Nishikawa, et al. Mutual view sharing system for real-time telecommunication, Systems and Computers in Japan 2006, 37 (14): p. 292-304.
Notice of Appeal and Amendment filed Feb. 12, 2013 for Application No. 2010-508631, filed May 19, 2008 (Applicant-UAB Research Foundation; Inventor-Guthrie, et al.;) (p. 1-8).
Notice of Appeal and Amendment filed Feb. 12, 2013 for Application No. 2010-508631, filed May 19, 2008 (Applicant—UAB Research Foundation; Inventor—Guthrie, et al.;) (p. 1-8).
Notification of Passing Preliminary Examination issued Apr. 17, 2010 by the State Intellectual Property Office of the People's Republic of China for Application No. 2008800243237 filed May 19, 2008 (Applicant-UAB Research Foundation; Inventor-Guthrie, et al.;) (p. 1-2).
Notification of Passing Preliminary Examination issued Apr. 17, 2010 by the State Intellectual Property Office of the People's Republic of China for Application No. 2008800243237 filed May 19, 2008 (Applicant—UAB Research Foundation; Inventor—Guthrie, et al.;) (p. 1-2).
Official Action issued Feb. 10, 2012 by the Japanese Patent Office for Application No. 2010-508631, filed May 19, 2008 (Applicant-UAB Research Foundation; Inventor-Guthrie, et al.;) (p. 1-4).
Official Action issued Feb. 10, 2012 by the Japanese Patent Office for Application No. 2010-508631, filed May 19, 2008 (Applicant—UAB Research Foundation; Inventor—Guthrie, et al.;) (p. 1-4).
Official Action on Formalities issued Feb. 21, 2013 by the Japanese Patent Office for Application No. 2010-508631, filed May 19, 2008 (Applicant-UAB Research Foundation; Inventor-Guthrie, et al.;) (p. 1-1).
Official Action on Formalities issued Feb. 21, 2013 by the Japanese Patent Office for Application No. 2010-508631, filed May 19, 2008 (Applicant—UAB Research Foundation; Inventor—Guthrie, et al.;) (p. 1-1).
Paul, et al. "Augmented virtuality based on stereoscopic reconstruction in multimodal image-guided neurosurgery: methods and performance evaluation," IEEE Trans Med Imaging 2005, 24 (11): p. 1500-1511.
Request for Examination and Request to Postpone filed Mar. 3, 2011 to IP Australia for Application No. 2008270883 filed May 19, 2008 (Applicant-UAB Research Foundation; Inventor-Guthrie, et al.;) (p. 1-18).
Request for Examination and Request to Postpone filed Mar. 3, 2011 to IP Australia for Application No. 2008270883 filed May 19, 2008 (Applicant—UAB Research Foundation; Inventor—Guthrie, et al.;) (p. 1-18).
Request for Examination of Patent issued Sep. 14, 2010 by IP Australia for Application No. 2008270883, filed May 19, 2008 (Applicant-UAB Research Foundation; Inventor-Guthrie, et al.;) (p. 1-1).
Request for Examination of Patent issued Sep. 14, 2010 by IP Australia for Application No. 2008270883, filed May 19, 2008 (Applicant—UAB Research Foundation; Inventor—Guthrie, et al.;) (p. 1-1).
Response and Amendment filed Feb. 23, 2010 to the European Patent Office for Application No. 20080826034, filed May 19, 2008 (Applicant-UAB Research Foundation; Inventor-Guthrie, et al.;) (p. 1-10).
Response and Amendment filed Feb. 23, 2010 to the European Patent Office for Application No. 20080826034, filed May 19, 2008 (Applicant—UAB Research Foundation; Inventor—Guthrie, et al.;) (p. 1-10).
Response and Amendment filed Oct. 17, 2012 by the European Patent Office for Application No. 08826034.4, filed May 19, 2008 (Applicant-UAB Research Foundation; Inventor-Guthrie, et al.;) (p. 1-16).
Response and Amendment filed Oct. 17, 2012 by the European Patent Office for Application No. 08826034.4, filed May 19, 2008 (Applicant—UAB Research Foundation; Inventor—Guthrie, et al.;) (p. 1-16).
Response to Examination Report filed Nov. 19, 2012 for Application No. 582133, filed May 19, 2008 (Applicant-UAB Research Foundation; Inventor-Guthrie, et al.;) (p. 1-8).
Response to Examination Report filed Nov. 19, 2012 for Application No. 582133, filed May 19, 2008 (Applicant—UAB Research Foundation; Inventor—Guthrie, et al.;) (p. 1-8).
Response to First Office Action filed Nov. 1, 2011 for Application No. 2008800243237, filed May 19, 2008 (Applicant-UAB Research Foundation; Inventor-Guthrie, et al.;) (p. 1-5).
Response to First Office Action filed Nov. 1, 2011 for Application No. 2008800243237, filed May 19, 2008 (Applicant—UAB Research Foundation; Inventor—Guthrie, et al.;) (p. 1-5).
Response to Official Action filed Aug. 10, 2012 for Application No. 2010-508631, filed May 19, 2008 (Applicant-UAB Research Foundation; Inventor-Guthrie, et al.;) (p. 1-5).
Response to Official Action filed Aug. 10, 2012 for Application No. 2010-508631, filed May 19, 2008 (Applicant—UAB Research Foundation; Inventor—Guthrie, et al.;) (p. 1-5).
Response to Postponing Request issued Mar. 7, 2011 by IP Australia for Application No. 2008270883, filed May 19, 2008 (Applicant-UAB Research Foundation; Inventor-Guthrie, et al.;) (p. 1-1).
Response to Postponing Request issued Mar. 7, 2011 by IP Australia for Application No. 2008270883, filed May 19, 2008 (Applicant—UAB Research Foundation; Inventor—Guthrie, et al.;) (p. 1-1).
Response to Second Office Action filed Aug. 15, 2012 for Application No. 2008800243237, filed May 19, 2008 (Applicant-UAB Research Foundation; Inventor-Guthrie, et al.;) (p. 1-5).
Response to Second Office Action filed Aug. 15, 2012 for Application No. 2008800243237, filed May 19, 2008 (Applicant—UAB Research Foundation; Inventor—Guthrie, et al.;) (p. 1-5).
Satava, R.M. "Medical applications of virtual reality," J Med Systems 1995, 19: p. 275-280.
Second Office Action issued May 3, 2012 by the State Intellectual Property Office of the People's Republic of China for Application No. 2008800243237, filed May 19, 2008 (Applicant-UAB Research Foundation; Inventor-Guthrie, et al.;) (p. 1-8).
Second Office Action issued May 3, 2012 by the State Intellectual Property Office of the People's Republic of China for Application No. 2008800243237, filed May 19, 2008 (Applicant—UAB Research Foundation; Inventor—Guthrie, et al.;) (p. 1-8).
Shuhaiber, J.H. "Augmented reality in surgery," Arch Surg. 2004, 139 (2): p. 170-174.
Soler, et al. "Virtual reality, augmented reality and robotics in surgical procedures of the liver," Th. M. Buzug and T.C. Lueth, editors. Perspectives in Image-guided Surgery 2004: p. 476-484.
Taffinder, et al. "Validation of virtual reality to teach and assess pscyhomotor skills in laparascopic surgery: results from randomized controlled studies using the MIST VR laparoscopic simulator," Medicine Meets Virtual Reality 1998: p. 124-133.
Theoktisto et al., "Enhancing collaboration in virtual reality applications," Computers and Graphics, vol. 29, No. 5, Oct. 1, 2005.
Third Office Action issued Dec. 28, 2012 by the State Intellectual Property Office of the People's Republic of China for Application No. 2008800243237, filed May 19, 2008 (Applicant-UAB Research Foundation; Inventor-Guthrie, et al.;) (p. 1-5).
Third Office Action issued Dec. 28, 2012 by the State Intellectual Property Office of the People's Republic of China for Application No. 2008800243237, filed May 19, 2008 (Applicant—UAB Research Foundation; Inventor—Guthrie, et al.;) (p. 1-5).
U.S. Appl. No. 13/476,712, filed May 21, 2012, Dillavou.
U.S. Appl. No. 13/727,202, filed Dec. 26, 2012, Dillavou.
Viciana-Abad, et al. "A preliminary study of presence in virtual reality training simulation for medical emergencies," Medicinal Meets Virtual Reality 2004, 12: p. 394-396.
Vogt, et al. "An ar system with intuitive user interface for manipulation and visualization of 3d medical data," Stud Health Technol Inform. 2004, 98: p. 397-403.
Voluntary Amendment filed Jan. 15, 2010 to Japan Patent Office for Application No. 2010/508631, filed May 19, 2008 (Applicant-UAB Research Foundation; Inventor-Guthrie, et al.;) (p. 1-14).
Voluntary Amendment filed Jan. 15, 2010 to Japan Patent Office for Application No. 2010/508631, filed May 19, 2008 (Applicant—UAB Research Foundation; Inventor—Guthrie, et al.;) (p. 1-14).
Wann, et al. "Natural problems for stereoscopic depth perception in virtual environments," Vision Research 1995, 35 (19): p. 2731-2736.
NZ582133A (en) 2012-12-21
Free format text: CONFIRMATORY LICENSE;ASSIGNOR:UNIVERSITY OF ALABAMA AT BIRMINGHAM;REEL/FRAME:049462/0817