Source: http://www.google.nl/patents/US20110216192
Timestamp: 2017-12-16 22:35:04
Document Index: 697296965

Matched Legal Cases: ['art 2010', 'art 2010', 'art 2000', 'art 2005', 'art 2005', 'art 2005', 'art 2007', 'art 2003', 'art 2005', 'art 2005', 'art 2005', 'art 2014', 'art 2015', 'art 2013', 'art 2010']

Patent US20110216192 - Broadband passive tracking for augmented reality - Google Patenten
Technologies are generally described for a broadband passive sensing and tracking system that may employ a number of passive receivers that each have the capability of sensing electromagnetic waves (e.g., Radio Frequency “RF” signals) from surrounding broadcast sources. Each passive receiver may...http://www.google.nl/patents/US20110216192?utm_source=gb-gplus-sharePatent US20110216192 - Broadband passive tracking for augmented reality
Publicatienummer US20110216192 A1
Aanvraagnummer US 12/719,797
Publicatiedatum 8 sept 2011
Aanvraagdatum 8 maart 2010
Prioriteitsdatum 8 maart 2010
Ook gepubliceerd als CN102656474A, CN102656474B, US8610771, US9390503, US20140085483, WO2011152902A1
Publicatienummer 12719797, 719797, US 2011/0216192 A1, US 2011/216192 A1, US 20110216192 A1, US 20110216192A1, US 2011216192 A1, US 2011216192A1, US-A1-20110216192, US-A1-2011216192, US2011/0216192A1, US2011/216192A1, US20110216192 A1, US20110216192A1, US2011216192 A1, US2011216192A1
Uitvinders Henry Leung, Xiaoxiang Liu
Oorspronkelijke patenteigenaar Empire Technology Development, Llc
Patentcitaties (61), Niet-patentcitaties (1), Verwijzingen naar dit patent (11), Classificaties (12), Juridische gebeurtenissen (3)
US 20110216192 A1
1. A method for tracking one or more objects of interest in an Augmented Reality (AR) systems the method comprising:
receiving signals at each one of a plurality of tracking sensors, wherein each of the plurality of tracking sensors form part of a broadband sensing network, the received signals correspond to one or more of a direct signal and/or an echo signal, and each echo signal is associated with a corresponding one of the direct signals that is scattered by the object of interest;
processing the received signals to generate data associated with the object of interest, wherein the data corresponds to one or more of a position parameter and/or a motion parameter associated with an object of interest; and
augmenting a real scene with employing one or more of the position parameter and/or the motion parameter to augment a real scene including the object of interest with at least one virtual object.
2. The method according to claim 1, wherein the signals are received at the plurality of tracking sensors integrated into a plurality of wireless communication devices communicating with a plurality of transmission sources.
3. The method according to claim 2, wherein the direct signals are transmitted from transmission sources that include one or more of: TV broadcast towers, Global System for Mobile communications (GSM) towers, Code Division Multiple Access (CDMA) cellular communication towers, Amplitude Modulation (AM) or Frequency Modulation (FM) broadcast towers, Digital Audio Broadcasting (DAB) sources, Digital Video Broadcasting-Terrestrial (DVB-T) sources, Wireless Local Area Network (WLAN) access points, Wide Area Network (WAN) access points, Metropolitan Area Network (MAN) access points, and/or Personal Area Network (PAN) access points.
4. The method according to claim 2, wherein the received signals correspond to one or more of: a TV signal, a digital TV signal, a GSM signal, a CDMA signal, an AM/FM signal, a DAB signal, a DVB-T signal, a WLAN signal, a WAN signal, a MAN signal, and/or a PAN signal.
5. The method according to claim 1, wherein processing the received signals includes one or more of
identifying each of the received signals as one or more of the direct signal and/or the echo signal through adaptive filtering;
6. The method according to claim 5, wherein pre-processing the received signals includes one or more of signal correction, bandwidth correction, signal averaging, amplification, down-conversion, and/or digitization.
7. The method according to claim 5, wherein processing the received signals to generate data associated with the object of interest comprises employing a beam forming process on the phase compensated signals to determine one or more of position and/or motion parameters associated with the object of interest.
8. The method according to claim 7, wherein employing the beam forming process further comprises
9. The method according to claim 1, wherein the signals are received from the tracking sensors that are communicatively coupled through a wireless network distinct from a communication network of corresponding wireless communication devices.
11. A system for tracking an object of interest in a real scene in Augmented Reality (AR) systems, the system comprising:
a plurality of tracking sensors, each tracking sensor adapted to:
receive signals corresponding to one or more of a direct signal and/or an echo signal, wherein the direct signals are associated with one or more corresponding transmission sources, and wherein the echo signals are associated with the one or more direct signals scattered from the object of interest; and
pre-process the received signals;
augment the real scene based on the tracking of the object of interest and the image information.
12. The system according to claim 11, wherein each tracking sensor comprises:
an adaptive filter adapted to process received echo signals to generate suppress clutter; and
13. The system according to claim 12, wherein one or more functions of the blind channel equalizer, the adaptive filter, and/or the correlator are provided by a digital signal processor.
14. The system according to claim 11, wherein the reality server comprises:
a tracking/localization module adapted to determine one or more of a position and/or a motion parameters for the object of interest based on the phase compensated signals;
15. The system according to claim 11, further comprising a visualization device adapted to generate a visualization of the augmented real scene.
16. The system according to claim 15, wherein the visualization device comprises one or more of a head-mounted display, a virtual retinal display, and/or a monitor.
17. The system according to claim 11, wherein a portion of the tracking sensors are homogeneous sensors adapted to receive the same type transmission and another portion of the tracking sensors are heterogeneous sensors adapted to receive different types of transmissions.
18. The system according to claim 11, wherein the reality server is further adapted to calibrate a synthesized array of antennas, the synthesized array of antennas comprising antennas from each of the tracking sensors, each of the tracking sensors being adapted to employ a location based service.
19. An apparatus for tracking one or more objects of interest in an Augmented Reality (AR) system, the apparatus comprising a wireless communication device including an antenna and a tracking sensor wherein the wireless communication device is adapted to:
receive signals with the antenna, wherein the received signals correspond to one or more of direct signals from one or more transmission sources or echo signals that are scattered from one or more of the objects of interest as a result of one or more of the direct signals;
phase compensate the one or more frequency domain signals to generate phase compensated signals; and
derive location and/or motion information associated with one or more of the objects of interest from the phase compensated signals.
20. The apparatus according to claim 19, wherein the wireless communication device is adapted to pre-process the received signals by applying one or more of signal correction, bandwidth correction, signal averaging, amplification, down-conversion, and/or digitization.
21. The apparatus according to claim 19, wherein the transmission sources comprise one or more of: TV broadcast towers, Global System for Mobile communications (GSM) towers, Code Division Multiple Access (CDMA) cellular communication towers, Amplitude Modulation (AM) or Frequency Modulation (FM) broadcast towers, Digital Audio Broadcasting (DAB) sources, Digital Video Broadcasting-Terrestrial (DVB-T) sources, Wireless Local Area Network (WLAN) access points, Wide Area Network (WAN) access points, Metropolitan Area Network (MAN) access points, and/or Personal Area Network (PAN) access points; and wherein the wireless communication device includes one or more of: a TV receiver, a digital TV receiver, a GSM device, a CDMA device, an AM/FM receiver, a DAB device, a DVB-T device, a WLAN device, a WAN device, a MAN device, and/or a PAN device.
22. An apparatus for tracking one or more objects of interest in Augmented Reality (AR) systems, the apparatus comprising:
a processor coupled to the memory, the processor configured in cooperation with the memory to execute an AR engine such that the processor is adapted to:
communicate with a plurality of tracking sensors integrated into AR enabled wireless devices through a wireless network that is distinct from communication networks of corresponding AR enabled wireless devices;
adaptively select a number and a location of the tracking sensors;
receive pre-processed signals that are detected by the tracking sensors wherein the pre-processed signals correspond to one or more of direct signals and/or echo signals that result from the direct signals being reflected by the one or more objects of interest; and
apply a beam forming process to the received signals to estimate location and motion parameters for one or more of the objects of interest.
23. The apparatus according to claim 22, wherein the processor is further configured by the beam forming process to select tracking sensors associated with one or more of transmission sources having distinct frequencies, transmission sources having distinct bandwidths, and/or transmission sources having distinct antenna patterns, whereby diversity gain may be increased.
24. The apparatus according to claim 22, wherein the processor is further adapted by the AR engine to provide the estimated location and motion parameters for the one or more objects of interest to an AR application, wherein the AR application is configured to generate and augmented reality scene by superimposing virtual objects generated based on the estimated location and motion parameters for the object of interest and a digitized image of the object of interest.
25. A computer-readable storage medium having instructions stored thereon for tracking one or more objects of interest in Augmented Reality (AR) systems, the instructions comprising:
at a tracking sensor receiving from a transmission source associated with a wireless device that includes the tracking sensor, one or more of direct signals from one or more transmission sources or echo signals that are scattered from one or more of the objects of interest as a result of one or more of the direct signals;
pre-processing the received signals at the tracking sensor;
phase compensating pairs of frequency spectrum signals received from a plurality of tracking sensors at a phase-compensation module; and
deriving location and/or motion information associated with one or more of the objects of interest from the phase compensated signals at a tracking/localization module by adaptively selecting a number and a location of the plurality of tracking sensors.
26. The computer-readable storage medium of claim 25, wherein the instructions further comprise:
adaptively filtering the received echo signals to generate suppress clutter.
27. The computer-readable storage medium of claim 25, wherein the instructions further comprise:
transmitting the tracking information to a wireless device executing an AR client application.
28. The computer-readable storage medium of claim 25, wherein the instructions further comprise:
FIG. 4 illustrates geometric representation 400 of a passive sensor network in a system arranged according to at least some embodiments described herein. For brevity and simplicity purposes, an object 490 with associated location vector ro is shown in geometric representation 400 with two transmission sources Tx1 and Tx2 at location vectors rT1 and rT2, respectively. Corresponding receivers Rx1 and Rx2 are located at the origin of the Cartesian coordinate system X, Y, Z. If a complex passive transmit signal denoted as:
τ i  ( r 0 ) = d Ti - d R c =  r Ti - r 0  -  r 0  c  ( 1 ≤ i ≤ 2 ) , [ 4 ]
τ i c  ( r 0 ) = τ i  ( r 0 ) - τ di =  r Ti - r 0  +  r 0  -  r Ti  c [ 8 ]
S1(f)≈rec(f/B1)∫Vg(r0)exp(−j2π(f+fc1)τ1 c(ro))dr0, and [9]
S2(f)≈rec(f/B2)∫Vg(r0)exp(−j2π(f+fc2)τ2 c(ro))dr0, [10]
ɛ  ( r 0 ) = τ 2 c  ( r 0 ) - τ 1 c  ( r 0 ) = (  r T   2 - r 0  -  r T   1 - r 0  ) - (  r T   2  -  r T   1  ) c .
US4137532 * 29 april 1977 30 jan 1979 Westinghouse Electric Corp. VIP doppler filter bank signal processor for pulse doppler radar
US5347541 * 2 nov 1992 13 sept 1994 The Regents Of The Univ. Of California Apparatus and method for utilizing a blind equalizer based on a Bayesian symbol sequence estimator for use in digital communication
US5828944 * 11 jan 1996 27 okt 1998 Illinois Superconductor Corporation Diversity reception signal processing system
US6500008 * 15 maart 2000 31 dec 2002 Information Decision Technologies, Llc Augmented reality-based firefighter training system and method
US6578017 * 25 feb 2000 10 juni 2003 Information Decision Technologies, Llc Method to aid object detection in images by incorporating contextual information
US6594616 * 18 juni 2001 15 juli 2003 Microsoft Corporation System and method for providing a mobile input device
US6607038 * 5 april 2001 19 aug 2003 Information Decision Technologies, Llc Instrumented firefighter's nozzle and method
US6760026 * 2 jan 2001 6 juli 2004 Microsoft Corporation Image-based virtual reality player with integrated 3D graphics objects
US6809743 * 6 aug 2002 26 okt 2004 Information Decision Technologies, Llc Method of generating three-dimensional fire and smoke plume for graphical display
US6809744 * 6 aug 2002 26 okt 2004 Information Decision Technologies, Llc Method for simulating flow of an extinguishing agent
US6822648 * 16 april 2002 23 nov 2004 Information Decision Technologies, Llc Method for occlusion of movable objects and people in augmented reality scenes
US6866512 * 6 aug 2002 15 maart 2005 Information Decision Technologies, Llc Ruggedized instrumented firefighter's vari-nozzle
US6901389 * 16 april 2002 31 mei 2005 Information Decision Technologies, Llc Method to augment imagery to display 3-D probabilistic object locations
US6903707 * 18 juli 2002 7 juni 2005 Information Decision Technologies, Llc Method for using a motorized camera mount for tracking in augmented reality
US6903752 * 10 juli 2002 7 juni 2005 Information Decision Technologies, Llc Method to view unseen atmospheric phenomenon using augmented reality
US6961070 * 16 april 2002 1 nov 2005 Information Decision Technologies, Llc Method to graphically represent weapon effectiveness footprint
US6989831 * 6 aug 2002 24 jan 2006 Information Decision Technologies, Llc Method for simulating multi-layer obscuration from a viewpoint
US7034779 * 17 dec 2003 25 april 2006 Information Decision Technologeis, Llc Advanced ruggedized augmented reality instrumented self contained breathing apparatus
US7035897 * 14 jan 2000 25 april 2006 California Institute Of Technology Wireless augmented reality communication system
US7042421 * 16 april 2004 9 mei 2006 Information Decision Technologies, Llc. Method for advanced imaging in augmented reality
US7046214 * 29 maart 2005 16 mei 2006 Information Decision Technologies, Llc Method and system for accomplishing a scalable, multi-user, extended range, distributed, augmented reality environment
US7057582 * 6 aug 2002 6 juni 2006 Information Decision Technologies, Llc Ruggedized instrumented firefighter's self contained breathing apparatus
US7071898 * 29 maart 2005 4 juli 2006 Information Decision Technologies, Llc Method for using a wireless motorized camera mount for tracking in augmented reality
US7110013 * 9 aug 2001 19 sept 2006 Information Decision Technology Augmented reality display integrated with self-contained breathing apparatus
US7138963 * 16 april 2004 21 nov 2006 Metamersion, Llc Method for automatically tracking objects in augmented reality
US7174031 * 17 mei 2005 6 feb 2007 Digimarc Corporation Methods for using wireless phones having optical capabilities
US7262747 * 12 mei 2006 28 aug 2007 Information Decision Technologies, Llc Method and apparatus for using thermal imaging and augmented reality
US7333135 * 15 okt 2002 19 feb 2008 Fuji Xerox Co., Ltd. Method, apparatus, and system for remotely annotating a target
US7372451 * 18 okt 2002 13 mei 2008 Accenture Global Services Gmbh Industrial augmented reality
US7395181 * 23 dec 2003 1 juli 2008 Massachusetts Institute Of Technology Motion tracking system
US7576727 * 15 dec 2003 18 aug 2009 Matthew Bell Interactive directed light/sound system
US7628074 * 15 maart 2007 8 dec 2009 Mitsubishi Electric Research Laboratories, Inc. System and method for motion capture in natural environments
US8045419 * 15 okt 2009 25 okt 2011 The United States Of America As Represented By The Secretary Of The Navy Method for mitigating spatial aliasing
US20020008153 * 5 april 2001 24 jan 2002 Ebersole John Franklin Instrumented firefighter's nozzle and method
US20020039085 * 9 aug 2001 4 april 2002 Ebersole John Franklin Augmented reality display integrated with self-contained breathing apparatus
US20020147544 * 11 feb 2002 10 okt 2002 Winged Systems Corporation High resolution autonomous precision positioning system
US20020149581 * 16 april 2002 17 okt 2002 Furlong Todd Joseph Method for occlusion of movable objects and people in augmented reality scenes
US20020191003 * 18 juli 2002 19 dec 2002 Hobgood Andrew W. Method for using a motorized camera mount for tracking in augmented reality
US20020191004 * 9 aug 2002 19 dec 2002 Ebersole John Franklin Method for visualization of hazards utilizing computer-generated three-dimensional representations
US20020196202 * 9 aug 2002 26 dec 2002 Bastian Mark Stanley Method for displaying emergency first responder command, control, and safety information using augmented reality
US20020197591 * 6 aug 2002 26 dec 2002 Ebersole John Franklin Method for simulating multi-layer obscuration from a viewpoint
US20030003430 * 6 aug 2002 2 jan 2003 Ebersole John Franklin Method for simulating flow of an extinguishing agent
US20030006045 * 6 aug 2002 9 jan 2003 Ebersole John Franklin Ruggedized instrumented firefighter's vari-nozzle
US20030014212 * 12 juli 2001 16 jan 2003 Ralston Stuart E. Augmented vision system using wireless communications
US20030017438 * 6 aug 2002 23 jan 2003 Ebersole John Franklin Method of generating three-dimensional fire and smoke plume for graphical display
US20030025714 * 10 juli 2002 6 feb 2003 Ebersole John Franklin Method to view unseen atmospheric phenomenon using augmented reality
US20030117342 * 6 aug 2002 26 juni 2003 Ebersole John Franklin Ruggedized instrumented firefighter's self contained breathing apparatus
US20030132283 * 8 aug 2002 17 juli 2003 Hobgood Andrew Wesley Method for utilizing smart cards for storing training and simulation information
US20030210228 * 31 maart 2003 13 nov 2003 Ebersole John Franklin Augmented reality situational awareness system and method
US20040130504 * 17 dec 2003 8 juli 2004 Ebersole John Franklin Advanced ruggedized augmented reality instrumented self contained breathing apparatus
US20040212630 * 16 april 2004 28 okt 2004 Hobgood Andrew W. Method for automatically tracking objects in augmented reality
US20050121031 * 31 dec 2004 9 juni 2005 Ebersole John F.Jr. Impact-protected advanced ruggedized augmented reality instrumented self contained breathing apparatus
US20050168403 * 29 maart 2005 4 aug 2005 Ebersole John F.Jr. Method and system for accomplishing a scalable, multi-user, extended range, distributed, augmented reality environment
US20050195279 * 29 maart 2005 8 sept 2005 Andrew Wesley Hobgood Method for using a wireless motorized camera mount for tracking in augmented reality
US20050275664 * 16 april 2004 15 dec 2005 Hobgood Andrew W Method for advanced imaging in augmented reality
US20060227998 * 29 maart 2005 12 okt 2006 Hobgood Andrew W Method for using networked programmable fiducials for motion tracking
US20060232499 * 12 mei 2006 19 okt 2006 Ebersole John F Method and Apparatus for Using Thermal Imaging and Augmented Reality
US20070132785 * 30 jan 2007 14 juni 2007 Ebersole John F Jr Platform for immersive gaming
US20080033604 * 17 april 2007 7 feb 2008 Jed Margolin System and Method For Safely Flying Unmanned Aerial Vehicles in Civilian Airspace
US20100002077 * 21 jan 2005 7 jan 2010 Sensis Corporation Method and system for tracking position of an object using imaging and non-imaging surveillance devices
1 * "System level Investigations of Television Based Bistatic Radar"A dissertation submitted to the Department of Electrical Engineering, University of Cape Town, in fulfilment of the requirernentsfor the degree of Master of Science in Engineering.Cape Town, December 2005
US9544534 * 24 sept 2013 10 jan 2017 Motorola Solutions, Inc. Apparatus for and method of identifying video streams transmitted over a shared network link, and for identifying and time-offsetting intra-frames generated substantially simultaneously in such streams
US9563265 15 aug 2012 7 feb 2017 Qualcomm Incorporated Augmented reality with sound and geometric analysis
US9638800 22 nov 2016 2 mei 2017 4Sense, Inc. Passive tracking system
US9720086 22 nov 2016 1 aug 2017 4Sense, Inc. Thermal- and modulated-light-based passive tracking system
US9761049 28 maart 2014 12 sept 2017 Intel Corporation Determination of mobile display position and orientation using micropower impulse radar
US20150085132 * 24 sept 2013 26 maart 2015 Motorola Solutions, Inc Apparatus for and method of identifying video streams transmitted over a shared network link, and for identifying and time-offsetting intra-frames generated substantially simultaneously in such streams
US20150172603 * 7 juli 2013 18 juni 2015 Reuven Gorodetski System and method for receipt acquisition
US20150319634 * 17 sept 2013 5 nov 2015 Gil Zwirn Acquiring information regarding a volume using wireless networks
US20160007161 * 30 maart 2013 7 jan 2016 Qatar University Qstp-B System and method for detection and tracking of wireless enabled objects
WO2015108582A3 * 21 okt 2014 24 sept 2015 Elwha Llc Antenna system facilitating reduction of interfering signals
WO2015148014A1 * 18 feb 2015 1 okt 2015 Intel Corporation Determination of mobile display position and orientation using micropower impulse radar
Classificatie in de VS 348/143, 348/E07.085, 348/E05.024, 348/169
Internationale classificatie H04N7/18, H04N5/225
Coöperatieve classificatie G06T7/73, G06T7/246, H04N7/18, H04N5/225, G06T19/006, G06T7/0042
9 maart 2010 AS Assignment
29 april 2014 CC Certificate of correction
25 mei 2017 FPAY Fee payment