Source: http://www.google.es/patents/US9411437
Timestamp: 2017-12-14 10:10:50
Document Index: 762237838

Matched Legal Cases: ['Application No. 60', 'Application No. 60', 'arts 1', 'arts 1', 'arts 708', 'arts 1']

Patente US9411437 - Easily deployable interactive direct-pointing system and presentation ... - Google Patentes
A method for controlling movement of a computer display cursor based on a point-of-aim of a pointing device within an interaction region includes projecting an image of a computer display to create the interaction region. At least one calibration point having a predetermined relation to said interaction...http://www.google.es/patents/US9411437?utm_source=gb-gplus-sharePatente US9411437 - Easily deployable interactive direct-pointing system and presentation control system and calibration method therefor
Número de publicación US9411437 B2
Número de solicitud US 14/712,788
También publicado como US7746321, US8049729, US8723803, US8866742, US9063586, US9785255, US20050270494, US20100283732, US20120007801, US20140152565, US20140354547, US20160054814, US20160306441, WO2005119356A2, WO2005119356A3
Número de publicación 14712788, 712788, US 9411437 B2, US 9411437B2, US-B2-9411437, US9411437 B2, US9411437B2
Cesionario original UltimatePointer, L.L.C.
Citas de patentes (176), Otras citas (53), Citada por (1), Clasificaciones (13)
US 9411437 B2
1. An apparatus for controlling contents of a computer generated image, comprising:
a first device that is designed to be handheld and wielded by a user in mid-air and comprises:
a first orientation sensor for providing a first orientation signal that is dependent on at least one orientation coordinate of the first orientation sensor;
at least one of a first power source and a connection to a second power source for supplying power to said first device; and
a first communication-and-control device coupled to said first orientation sensor and for providing first data that is dependent on said first orientation signal;
a second device that is designed to be head-mounted and comprises:
a second orientation sensor for providing a second orientation signal that is dependent on at least one orientation coordinate of the second orientation sensor;
at least on of a third power source and a connection to a fourth power source for supplying power to said second device; and
a second communication-and-control device coupled to said second orientation sensor and for providing second data that is dependent on said second orientation signal;
a display device for coupling to the computer and for displaying the computer generated image; and
a third communication-and-control device for coupling to the computer and for receiving the first and second data and for providing third data to the computer,
wherein said third data is used by the computer to control said contents.
the first orientation sensor comprises a first accelerometer and a first gyro and a first magnetometer,
the first orientation signal depends on at least two orientation coordinates of the first orientation sensor,
the second orientation sensor comprises a second accelerometer and a second gyro and a second magnetometer, and
the second orientation signal depends on at least two orientation coordinates of the second orientation sensor.
3. The apparatus according to claim 2 wherein the display device has a fixed position relative to the second device.
4. The apparatus according to claim 1 wherein said one orientation coordinate of the first orientation sensor is relative to a coordinate system that has at least one coordinate axis with fixed orientation relative to the second device.
5. The apparatus according to claim 1 wherein the second device is a base station that has a fixed position and a fixed orientation relative to the display device.
6. The apparatus according to claim 5 wherein the first device further comprises:
a first position sensor coupled to the first communication-and-control device and for providing a first position signal that is dependent on at least one position coordinate of the first position sensor relative to the base station, and
wherein the first data is dependent on the first position signal.
7. The apparatus according to claim 6 wherein the first orientation signal depends on at least two orientation coordinates of the first orientation sensor relative to the base station, and
wherein the first position signal depends on at least two position coordinates of the first position sensor relative to the base station.
8. A non-transitory computer-readable medium or media storing computer-executable instructions for causing a computer to perform a method for controlling a feature on a rectangular computer screen interaction region in conjunction with a first sensing device that has a fixed relation to a pointing line, the computer screen interaction region lying on a rectangular screen and having four edges parallel to edges of said screen,
a first communication-and-control device; and
a processing unit coupled to the first communication-and-control device and to said medium or media,
the first sensing device comprising:
an accelerometer for generating a first output signal;
a gyro for generating a second output signal; and
a second communication-and-control device coupled to said accelerometer and said gyro and configured to allow coupling to the first communication-and-control device and for providing first data to said first communication-and-control device,
wherein said first data is dependent on at least one of said first output signal and said second output signal and is sensitive to orientation of said pointing line when the position of the first sensing device is constant, said orientation being relative to a coordinate system defined by three perpendicular coordinate axes of which a first and a second coordinate axis are horizontal and a third coordinate axis is vertical,
developing second data that is dependent on the first data;
using said second data to control the feature on the computer screen interaction region,
wherein the step of controlling the feature is independent of orientation of the computer screen interaction region relative to said coordinate system and for fixed positions of said first sensing device and positions of said feature inside the computer screen interaction region operates so that the feature is kept at substantially the same distance from a first edge of the computer screen interaction region if said second data is indicative of the pointing line having substantially remained in a plane parallel to said third coordinate axis.
9. The non-transitory computer-readable medium or media according to claim 8 wherein said first data depends on said first output signal and said second output signal and is indicative of an angle between said pointing line and a line that is vertical.
10. The non-transitory computer-readable medium or media according to claim 9 wherein said pointing line defines a point-of-aim as the intersection of the pointing line with an interaction structure that is a non-flat surface that is perpendicular to the first and second coordinate axes, and
wherein for fixed positions of the first sensing device and positions of said feature inside said computer screen interaction region the step of controlling the feature operates so that the feature is kept at the same distance from the first edge of the computer screen interaction region if said second data indicates that the motion of the point-of-aim has no substantial horizontal component and so that the feature is kept at the same distance from a second edge of the computer screen interaction region if said second data indicates that the motion of the point-of-aim has no substantial vertical component, said second edge being perpendicular to said first edge.
11. The non-transitory computer-readable medium or media according to claim 8,
wherein said pointing line defines a point-of-aim as the intersection of the pointing line with an interaction structure that is perpendicular to the first and second coordinate axes,
wherein said first data depends on said first output signal and said second output signal, and
wherein for fixed positions of the first sensing device and positions of said feature inside said computer screen interaction region the step of controlling the feature operates so that the feature is kept at the same distance from the first edge of the computer screen interaction region if said second data indicates that the point-of-aim has moved only vertically.
12. The non-transitory computer-readable medium or media according to claim 11 where said interaction structure is a rectangle with an edge parallel to said third coordinate axis.
13. The non-transitory computer-readable medium or media according to claim 8 wherein the first sensing device and the second communication-and-control device are housed in an enclosure that is designed to be handheld and used in mid-air.
14. The non-transitory computer-readable medium or media according to claim 13,
wherein said enclosure comprises a manipulation device coupled to said second communication-and-control device and designed to allow a user to manipulate two independent positional coordinates of the feature on the computer screen interaction region, said manipulation device for generating a third output signal that is independent of orientation of said enclosure, and
wherein said first data depends on said third output signal.
15. The non-transitory computer-readable medium or media according to claim 14, wherein said manipulation device is a thumbstick.
16. The non-transitory computer-readable medium or media according to claim 13, wherein said first sensing device furthermore comprises an image capturing device for providing a third output signal that is sensitive to orientation of the first sensing device, and wherein said first data depends on said third output signal.
17. The non-transitory computer-readable medium or media according to claim 13,
wherein said first communication-and-control device is designed to be coupled to a third communication-and-control device that is for providing third data to the first communication-and-control device, said third data being dependent on position of the enclosure, and
developing fourth data that is dependent on the third data; and
using said fourth data to control the feature on the computer screen interaction region.
18. A non-transitory computer-readable medium or media storing computer-executable instructions for causing a computer to perform a method for controlling contents of a computer-generated image in conjunction with a first sensing device that is coupled to said computer and in conjunction with an enclosure that is designed to be handheld by a user in mid-air and that contains a second sensing device comprising an accelerometer and a gyro, said second sensing device for generating orientation data that is dependent on orientation of said enclosure, the method comprising the steps of:
querying the user to align said enclosure in a way that allows said first sensing device to generate first data that is dependent on the distance between the enclosure and the computer-generated image,
causing said first sensing device to generate the first data, and
using the first data to control the contents of the computer-generated image.
19. The non-transitory computer-readable medium or media according to claim 18,
wherein said enclosure is associated with a pointing line that intersects the enclosure and has a fixed orientation relative to the second sensing device, and
wherein said querying the user is querying the user to align the enclosure in such a way that said pointing line is substantially perpendicular to the computer-generated image.
20. The non-transitory computer-readable medium or media according to claim 18, wherein said first sensing device has components contained in a base station that is positioned in and aligned with a plane that contains the computer-generated image.
This application is a continuation of application Ser. No. 14/463,405, filed Aug. 19, 2014, which is hereby incorporated by reference, which in turn is a continuation of application Ser. No. 14/175,960, filed Feb. 7, 2014, now U.S. Pat. No. 8,866,742, which is hereby incorporated by reference, which in turn is a continuation of application Ser. No. 13/239,140, filed Sep. 21, 2011, now U.S. Pat. No. 8,723,803, which is hereby incorporated by reference, which in turn is a continuation of a continuation of application Ser. No. 12/782,980, filed May 19, 2010, now U.S. Pat. No. 8,049,729, which is hereby incorporated by reference, which in turn is a continuation of application Ser. No. 11/135,911, filed May 24, 2005, now U.S. Pat. No. 7,746,321, which is hereby incorporated by reference, which in turn claims priority from U.S. Provisional Application No. 60/575,671 filed on May 28, 2004 and from U.S. Provisional Application No. 60/644,649 filed on Jan. 18, 2005, which are hereby incorporated by reference.
Indirect pointing devices known in the art include the following. U.S. Pat. No. 4,654,648 to Herrington et al. (1987), U.S. Pat. No. 5,339,095 to Redford (1994), U.S. Pat. No 5,359,348 to Pilcher et al. (1994), U.S. Pat. No. 5,469,193 to Giobbi et al. (1995), U.S. Pat. No. 5,506,605 to Paley (1996), U.S. Pat. No. 5,638,092 to Eng et al. (1997), U.S. Pat. No. 5,734,371 to Kaplan (1998), U.S. Pat. No. 5,883,616 to Koizumi et al. (1999), U.S. Pat. No. 5,898,421 to Quinn (1999), U.S. Pat. No. 5,963,134 to Bowers et al. (1999), U.S. Pat. No. 5,999,167 to Marsh et al. (1999), U.S. Pat. No. 6,069,594 to Barnes et al. (2000), U.S. Pat. No. 6,130,664 to Suzuki (2000), U.S. Pat. No. 6,271,831 to Escobosa et al. (2001), U.S. Pat. No. 6,342,878 to Chevassus et al. (2002), U.S. Pat. No. 6,388,656 to Chae (2002), U.S. Pat. No. 6,411,277 to Shah-Nazaroff (2002), U.S. Pat. No. 6,492,981 Stork et al. (2002), U.S. Pat. No. 6,504,526 to Mauritz (2003), U.S. Pat. No. 6,545,664 to Kim (2003), U.S. Pat. No. 6,567,071 to Curran et al. (2003) and U.S. Patent Application Publication No. 2002/0085097 to Colmenarez et (2002). Each of the foregoing publications discloses a system for which the 2 dimensional or 3 dimensional position, orientation and/or motion of an object, such as a handheld pointing device, are measured with respect to some reference coordinate system using appropriate means. Such means include acoustic devices, electromagnetic devices, infrared devices, visible light emitting diode (LED) devices, charge coupled devices (CCD), accelerometer and gyroscopic motion detectors, etc. Although for some of the foregoing devices the reference coordinate system may be positioned close to the display means, no information on the actual position of the presentation display with respect to the system is used, causing the resulting pointing action to be inherently indirect and, hence, less natural to the human operators of such systems.
U.S. Pat. No. 6,373,961 to Richardson et al. (2002) discloses a direct-pointing system using helmet-mounted eye tracking means. The point-of-gaze relative to the helmet is measured as well as the position and orientation of the helmet relative to the display. The latter is accomplished by equipping the helmet either with means to image sources mounted at fixed positions around the display or with means to image a displayed calibration pattern. Of course, the foregoing system relies on sophisticated helmet mounted equipment capable of, among other things, tracking eye-movement. Moreover, such a system relies on an uobstructed line-of-sight with respect to the display and a substantially constant distance from the display to the helmet-mounted equipment. The disclosed invention does not lend itself to be easily used by a human operator in an arbitrary (not predetermined) presentation setting.
In addition to set P, a 3D point CA and another 3D point CB are determined at 90 a. These additional 3D points are determined so as to lie away from interaction region 71, that is, they lie at some distance out of the plane that is closest to. or substantially contains interaction region 71. The distance may be comparable to an edge of projection image 70. For example, point CA may be determined to lie near projection device 40 and point CB may be determined to lie at a distance from point CA that may be equal to the distance between projection device 40 and projection surface 60 measured substantially parallel to projection surface 60. Other choices for point CA and point CB may also be used. Additionally, sets A and B are generated during step 90 a. Set A includes a number n of lines A(i), each of which connects point CA to one of the points C(i) (0<1<n+1) in set P. Likewise, set B holds a number n of lines B(i), each of which connects point Ca to one of the points C(i) (0<i<n+1) in set P. Finally, at 90 a, counters a, b are both initialized to the value of n.
After 100 j program flow continues to look where a decision is made whether p is equal to n+1. If the decision is positive, it is concluded that all necessary data for lines B(P) has been ascertained and program flow continues to 100 p. If the decision is negative, program flow reverts to 100 i.
If the decision at nod is negative, program flow continues to 110 e, where the light-beam projection device 202 can be instructed or caused to de-activate (using, for example, control device 204 and/or 304). Furthermore, a software routine (not shown) that controls computer cursor 501 (see also FIG. 2) is instructed that the user does not want to execute a direct-pointing action, after which program flow reverts to 110 c. Such cursor control routines are well known to those skilled in the art and are therefore not described here.
If the decision at nod is positive, program flow continues to 110 f, where a decision is made whether the z′-axis intersects interaction structure 72. Those skilled in the art will appreciate that this is possible because all relevant 3D information is known or is measurable by coordinate sensing device 201 and 301. If the decision is positive, program flow continues to 110 b, at which method M is used to map the intersection point of the z′-axis with interaction structure 72 to computer screen interaction region 51. This mapped position, as well as the user's desire to execute a direct-pointing action, are communicated to the cursor control routine (not shown) running on the computer.
Referring to FIGS. 6 and 7, program element 11 oa may then result in the description of interaction structure 72 as a rectangle with upper-right corner C(I), upper-left corner C(2) and lower-left corner C(3). Step 110 b may then result in a method M that maps a point 8 (not shown) in interaction structure 72 to a point E (not shown) in computer screen interaction region 51 in such a way that the ratio of distances between δ and any two of the four corners of interaction structure 72 is the same as the ratio of distances between E and the two corresponding corners of computer screen interaction region 51, as will be appreciated by those skilled in the art. Steps 110 c-k may then result in a very intuitive cursor control device that responds to a direct-pointing action by deactivating light-beam projection device 202 and showing cursor 501 at substantially point-of-aim 210 of pointing device 20 whenever point-of-aim 210 lies in projection image 70 (which in this example, by assumption, substantially coincides with interaction region 71). Since there is no necessity for a computer generated cursor and a light spot to be visible simultaneously there will not be any cause for confusion as to which of the two is the ‘actual cursor’. Cursor 501 may be hidden from view when point-of-aim 210 does not lie in interaction structure 72, in which case light-beam projection device 202 may be activated automatically. Also, intuitive actions such as ‘double click’ may be provided by steps 110 c-k.
Referring to FIGS. 4 and 8, program element 90 a may then result in a set P containing three points that define the upper-left corner C(1), the upper-right corner C(2) and the lower-left corner C(3) of interaction structure 72. Additionally, program element 90 a may determine point CA (not denoted as such in FIG. 8) to lie away from projection region 60, for example, at the center of one of the three instantiations of pointing device 20, as shown in FIG. 8. Point CB (not denoted as such in FIG. 8) may be determined to be displaced from point CA in a direction substantially parallel to interaction region 71, over a distance that may be the same order of magnitude as the size of interaction region 71. Program element 90 a may also result in sets A and B each containing three lines, connecting the points in set P to points CA and CB respectively. Program element 90 c may then result in a priori relationships requiring that the upper-left corner will have x- and y-coordinates equal to the x- and y-coordinates of the lower-left corner and that its z-coordinate will be equal to the z-coordinate of the upper-right corner. As will be explained in detail below, the a priori information together with complete 3D information on two lines in set A and one line in set B will be enough to uniquely determine the position, size and orientation of interaction structure 72 with respect to the x y z coordinate system. Therefore, program elements 90 d, 90 e, 90 f, 90 g may result in set B containing only line B(3). Moreover, program elements 90 g, 90 i, 90 j, 90 k may result in set A containing only lines A(1) and A(2)
( λ 1 λ 2 λ 3 ) = ( τ τ Rz 1 / τ Rz 2 0 ) ( 7 )
After program element 120 h, program flow continues with program elements outlined in FIG. 12. Referring to FIG. 12, program elements 130 a-130 g are seen to be similar to steps 100 a-100 p (FIG. 5). Comparing program element 130 f with program element roof (FIG. 5), it can be seen that at 130 f the program also stores information on the point-of-aim-distance (211 in FIG. 2) between the origin of the x′ y′ z′ coordinate system and point C(p). Comparing elements 130 g and 100 p (FIG. 5), it can be seen that these point-of-aim-distances (211 in FIG. 2) are also used in determining the 3D coordinates of the points in set P.
where α is any arbitrary real number, will generate solutions for interaction structure 72 that are parallel to each other. The assumption that the distance between pointing device 20 and the lower left corner of interaction structure 72 is 1 will hence uniquely generate one of these solutions. To see that other assumptions regarding this distance do not influence the operation of the present embodiment, reference is made to FIG. 15. In FIG. 15, projections of two parallel solutions for interaction structure 72 are shown, obtained for different values of distances CA-C(3). When it is assumed, for purposes of explanation, that these two solutions are parallel to the z-x plane, FIG. 15 may be interpreted as a projection of the two solutions onto the x-y plane. These projections are shown as the thick line segments C(3)-C(2) and CC3-CC2. FIG. 15 also shows the projection of point CA (i.e., the origin of coordinate system x y z), from where the lower left and upper right corners of interaction structure 72 were highlighted, and line-segments C(3)-CA and C(2)-CA which coincide with the (projections of) the highlighting lines A(3) and A(2) (not denoted as such in FIG. 15). Finally, line-segment BB1-CA indicates (the projection of) a pointing line that is consistent with a point-of-aim BB1 on the one and point-of-aim BB2 on the other of the two solutions for interaction structure 72. To show that BB1 and BB2 represent the same horizontal coordinate when measured relative to the appropriate solution for interaction structure 72, the lengths of line segments C(3)-BB1, C(2)-BB1, CC3-BB2, CC2-BB2, BB1-CA and BB2-CA are represented by bb1, bb2, b1, b2, aa12 and a12, respectively. It is sufficient to show that bb1/bb1=b1/b2. Consider the following equalities:
bb 1 sin β1 = aa 12 sin α1 ( 14 ) bb 2 sin β 2 = aa 12 sin α 2 ( 15 )
b 1 sin β1 = a 12 sin α1 ( 16 ) b 2 sin β 2 = a 12 sin α 2 ( 17 )
There may be situations in which the user is not able to hold pointing device 20 continuously at precisely the same position while performing the actions required by the calibration procedure described in FIGS. 3,11 and 14, or during the use of the system as a direct-pointing device. Such changes in position of the pointing device 20 can cause errors in the calculation of the point-of-aim. It will be appreciated that if the discrepancy between the calculated and the true point-of-aim is small enough, the visual feedback provided by the displayed cursor (501 in FIG. 1) during use of the system as a direct-pointing device will still afford the user the perception that direct-pointing is being performed.
At 150 d, a decision is made whether the user has requested sound playback. If this decision is positive, program flow continues to 150 g. If the decision is negative, program flow continues to 150 i.
Moreover, the features of the present invention that enable the tracking of point-of-aim relative to an interaction region may be enhanced by algorithms that allow the filtering of involuntary, fast and/or small hand-movements (that may be caused, for example, by the activation of buttons). Such algorithms may be used to control a point that moves less erratically than the actual point-of-aim while still being associated with it. Such motion filtering may produce a more steady motion of cursor 501. Such algorithms may also be used when the user is required to highlight calibration points 721 a, 721 b, Filter algorithms are well-known in the art.
Referring to FIG. 19, in another embodiment, different devices than light-beam projection devices may be used to determine the position of the points in set P. For example, light-beam projection device 202 may be omitted in an embodiment where pointing device 20 has the general shape of an elongated body, such as a pointing stick. The length of this stick may be predetermined or variable. For example, pointing device 20 could be in the shape of an extendable, or telescopic pen such as the INFINITER Laser Baton sold by Bluesky Marketing-Unit 29, Six Harmony Row, Glasgow, G51 3BA, United Kingdom. The process of highlighting a calibration point 721 a, 721 b, . . . , in this embodiment may be replaced by the action of pointing to the calibration point 721 a, 721 b, . . . , thereby guided by the elongated shape of pointing device 20 instead of the light spot shown in FIG. 18 at point-of-aim 210. Distance measuring device 206 may also be provided in a related embodiment, similar to the second described embodiment. For example, distance measuring device 206 may include a device to measure the distance from the tip of the elongated body of pointing device 20 to the origin of the x′ y′ z′ coordinate system. In such an embodiment, in order to obtain measurements of point-of-aim distance 211, as described for example at program element 130 f (see FIG. 12), the user might be queried to make physical contact between the tip of pointing device 20 and the calibration point. Referring to FIG. 19, pointing device 20 may also comprise contact-sensing device 207, for example at the tip of pointing device 20, capable of indicating physical contact between the tip of pointing device 20 and a surface. Contact-sensing device 207 may be in the form of a pressure-sensor or switch. Such sensors are known in the art.
US8866742 * 7 Feb 2014 21 Oct 2014 Ultimatepointer, Llc Easily deployable interactive direct-pointing system and presentation control system and calibration method therefor
11 Mark Ashdown, Peter Robinson, "The Writing's on the Wall: Large, Remotely Controlled Displays", Proceedings of the First European Conference on Computer-Supported Collaborative Learning, Mar. 22-24, 2001,p. 83-88.
12 Mark Ashdown, Peter Robinson; The Escritoire: A Personal Projected Display for Interacting With Documents; Technical Report; No. 538; University of Cambridge Computer Laboratory; Jun. 2002; UCAM-CL-TR-538; ISSN 1476-2986.
13 Mark Ashdown; Personal Projected Displays; Technical Report; No. 585; University of Cambridge Computer Laboratory; Mar. 2004; UCAM-CL-TR-585; ISSN 1476-2986.
14 Matej Andrejasic; "MEMS Accelerometers"; University of Ljubljana; Mar. 2008.
15 Midway Games, Inc.; CarnEvil Arcade Game Operation Manual; Nov. 1998.
16 Mihran Tuceryan, Douglas S. Greer, Ross T. Whitaker, David E. Breen, Eric Rose, Klaus H. Ahlers, Chris Crampton; "Calibration Requirements and Procedures for a Monitor-Based Augmented Reality System"; IEEE Transactions on Visualization and Computer Graphics; pp. 255-273; Sep. 1995.
17 Mihran Tuceryan, Yakup Genc, Nassir Navab; "Single-Point Active Alignment Method (SPAAM) for Optical See-Through HMD Calibration for Augmented Reality"; MIT; Presence: Teleoperators and Virtual Environments; pp. 259-276; Jun. 2002.
19 Pierre David Wellner, "Interacting with paper on the DigitalDesk", http://www.cl.cam.ac.uk/techreports/UCAM-CL-TR-330.html, Mar. 1994, p. 1-107.
20 Provisional U.S. Appl. No. 60/566,444; Freespace Pointing Device; Apr. 30, 2004.
21 Provisional U.S. Appl. No. 60/612,571; Free Space Pointing Devices and Methods; Sep. 23, 2004.
22 Provisional U.S. Appl. No. 60/641,410; Free Space Pointing Devices and Methods for Using Same; Jan. 5, 2005.
23 Rahul Sukthankar, Robert G. Stockton, Matthew D. Mullin; Smarter Presentations: Exploiting Homography in Camera-Projector Systems; Eighth IEEE International Conference on Computer Vision, Proceedings; Jul. 7-14, 2001; pp. 247-253.
24 Ramesh Raskar, Jeroen van Baar, Paul Beardsley, Thomas Willwacher, Srinivas Rao, Clifton Forlines; "iLamps: Geometrically Aware and Self-Configuring Projectors"; ACM Transactions on Graphics-Proceedings of Siggraph 2003; Jul. 2003.
25 Ronald Azuma, Bruce Hoff, Howard Neely III, Ron Sarfaty, "A Motion-Stabilized Outdoor Augmented Reality System," Proceedings of IEEE Virtual Reality '99 (Houston, TX, Mar. 13-17, 1999), p. 252-259.
26 Sega Enterprises, Ltd.; Confidential Mission Owner's Manual; Dec. 2000.
27 Sega Enterprises, Ltd.; House of the Dead 2 Arcade Owner's Manual; 1998.
28 Sega Enterprises, Ltd.; House of the Dead 3 Operator's Manual; Jan. 2003.
29 Sega Enterprises, Ltd.; House of the Dead Arcade Game Operator's Manual; 1997.
30 Sega of America, Inc.; House of the Dead User's Manual; 1995.
31 Sega of America, Inc.; Virtua Cop, Sega Saturn Console Game User's Manual and series of Sega Saturn Technical Bulletins1-41, SOA-1 to SOA-12; May 1995 to May 1996.
32 Thomas Fuhrmann, Markus Klein, Manuel Odendahl; "Bluewand-A versatile remote control and pointing device"; KiVS Kurzbeitrage, VDE Verlag; pp. 81-88; 2003.
33 Ultimatepointer, L.L.C. vs. Nintendo Co., Ltd. et al.; U.S. District Court, E.D. Tex. Civil Action No. 6:11-CV-00571-LED; Defendants' First Amended Invalidity Contentions with claim charts 1-760; Jun. 28, 2013.
34 Ultimatepointer, L.L.C. vs. Nintendo Co., Ltd. et al.; U.S. District Court, E.D. Tex. Civil Action No. 6:11-CV-00571-LED; Defendants' Motion for Summary Judgment of Invalidity Based on Indefiniteness Under 35 U.S.C. 112 ¶2; Dec. 21, 2012.
35 Ultimatepointer, L.L.C. vs. Nintendo Co., Ltd. et al.; U.S. District Court, E.D. Tex. Civil Action No. 6:11-CV-00571-LED; Defendants' Reply in Support of Motion for Summary Judgment of Invalidity Based on Indefiniteness Under 35 U.S.C. 112 ¶2; Jan. 16, 2013.
36 Ultimatepointer, L.L.C. vs. Nintendo Co., Ltd. et al.; U.S. District Court, E.D. Tex. Civil Action No. 6:11-CV-00571-LED; Defendants' Responsive Claim Construction Brief; Dec. 17, 2012.
37 Ultimatepointer, L.L.C. vs. Nintendo Co., Ltd. et al.; U.S. District Court, E.D. Tex. Civil Action No. 6:11-CV-00571-LED; First Amended Joint Claim Construction and Prehearing Statement in Compliance With Patent Rule 4-3; Nov. 19, 2012.
38 Ultimatepointer, L.L.C. vs. Nintendo Co., Ltd. et al.; U.S. District Court, E.D. Tex. Civil Action No. 6:11-CV-00571-LED; Invalidity Expert Report of Gregory Welch; Jan. 8, 2014 with Exhibits 1-16.
39 Ultimatepointer, L.L.C. vs. Nintendo Co., Ltd. et al.; U.S. District Court, E.D. Tex. Civil Action No. 6:11-CV-00571-LED; Joint Claim Construction and Prehearing Statement in Compliance With Patent Rule 4-3; Nov. 12, 2012.
40 Ultimatepointer, L.L.C. vs. Nintendo Co., Ltd. et al.; U.S. District Court, E.D. Tex. Civil Action No. 6:11-CV-00571-LED; Memorandum Opinion and Order; May 28, 2013.
41 Ultimatepointer, L.L.C. vs. Nintendo Co., Ltd. et al.; U.S. District Court, E.D. Tex. Civil Action No. 6:11-CV-00571-LED; Nintendo Defendants' Preliminary Invalidity Contentions with claim charts 1-683; Aug. 8, 2012.
42 Ultimatepointer, L.L.C. vs. Nintendo Co., Ltd. et al.; U.S. District Court, E.D. Tex. Civil Action No. 6:11-CV-00571-LED; Nintendo Defendants' Supplemental Invalidity Contentions claim charts 708-723; Dec. 10, 2012.
45 Ultimatepointer, L.L.C. vs. Nintendo Co., Ltd. et al.; U.S. District Court, E.D. Tex. Civil Action No. 6:11-CV-00571-LED; Retailer Defandants' Invalidity Contentions with claim charts 1-707; Oct. 12, 2012.
48 Ultimatepointer, L.L.C. vs. Nintendo Co., Ltd. et al.; U.S. District Court, E.D. Tex. Civil Action No. 6:11-CV-00571-LED; UltimatePointer, L.L.C.'s Second Amendment Disclosure of Asserted Claims and Infringement Contentions Pursuant to Patent Local Rule 3-1 and 3-2 for U.S. Pat. No. 7,746,321 with Proposed Second Amended Claim Chart; Dec. 10, 2012.
49 Ultimatepointer, L.L.C. vs. Nintendo Co., Ltd. et al.; U.S. District Court, E.D. Tex. Civil Action No. 6:11-CV-00571-LED; UltimatePointer, L.L.C.'s Second Amendment Disclosure of Asserted Claims and Infringement Contentions Pursuant to Patent Local Rule 3-1 and 3-2 for U.S. Pat. No. 7,746,321 with Proposed Second Amended Claim Chart; Jun. 14, 2013.
50 Ultimatepointer, L.L.C. vs. Nintendo Co., Ltd. et al.; U.S. District Court, E.D. Tex. Civil Action No. 6:11-CV-00571-LED; UltimatePointer, L.L.C.'s Second Amendment Disclosure of Asserted Claims and Infringement Contentions Pursuant to Patent Local Rule 3-1 and 3-2 for U.S. Pat. No. 8,049,729 with Proposed Second Amended Claim Chart; Dec. 10, 2012.
51 Ultimatepointer, L.L.C. vs. Nintendo Co., Ltd. et al.; U.S. District Court, E.D. Tex. Civil Action No. 6:11-CV-00571-LED; UltimatePointer, L.L.C.'s Third Amended Disclosure of Asserted Claims and Infringement Contentions for U.S. Pat. No. 8,049,729 Pursuant to Patent Local Rule 3-1 and 3-2 with Claim Chart; Jun. 14, 2013
52 Ultimatepointer, L.L.C. vs. Nintendo Co., Ltd. et al.; U.S. District Court, W.D. Wash. Civil Action No. C14-0865RSL; Order Granting Defendants' Motion for Summary Judgment of Non-Infringement; Dec. 22, 2014.
53 Ultimatepointer, L.L.C. vs. Nintendo Co., Ltd. et al.; U.S. District Court, W.D. Wash. Civil Action No. C14-0865RSL; Order Regarding Plaintiff'S Motion for Summary Judgment; Dec. 22, 2014.
Clasificación internacional G06F3/0346, G06F3/0354, G09G5/00, G03B21/00, G06F3/033, G06F3/042
Clasificación cooperativa G03B21/006, G06F3/038, G06F3/005, G06F3/012, G03B21/00, G06F3/0346, G06F3/03549