Source: http://www.google.com/patents/US7358962?dq=3691140
Timestamp: 2014-09-22 01:23:20
Document Index: 353790485

Matched Legal Cases: ['art 900', 'art 900', 'art 900', 'art 1000', 'art 1000', 'art 900', 'art 1100', 'art 1100', 'art 1100', 'art 1000', 'art 1200', 'art 1100', 'art 1200']

Patent US7358962 - Manipulating association of data with a physical object - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign in<nobr>Advanced Patent Search</nobr>PatentsData elements stored in a computing system and associated with a physical object are reassociated with the same or another physical object. An identifying characteristic presented by the physical object, such as a reflective pattern applied to the object, is detected when the object is positioned adjacent...http://www.google.com/patents/US7358962?utm_source=gb-gplus-sharePatent US7358962 - Manipulating association of data with a physical objectAdvanced Patent SearchPublication numberUS7358962 B2Publication typeGrantApplication numberUS 10/994,899Publication dateApr 15, 2008Filing dateNov 22, 2004Priority dateJun 15, 2004Fee statusPaidAlso published asUS7479950, US20050275636, US20080231609Publication number10994899, 994899, US 7358962 B2, US 7358962B2, US-B2-7358962, US7358962 B2, US7358962B2InventorsJoel P. Dehlin, Steven M. Drucker, Curtis Glenn Wong, Asta J. RosewayOriginal AssigneeMicrosoft CorporationExport CitationBiBTeX, EndNote, RefManPatent Citations (9), Non-Patent Citations (77), Referenced by (11), Classifications (13), Legal Events (2) External Links: USPTO, USPTO Assignment, EspacenetManipulating association of data with a physical objectUS 7358962 B2Abstract Data elements stored in a computing system and associated with a physical object are reassociated with the same or another physical object. An identifying characteristic presented by the physical object, such as a reflective pattern applied to the object, is detected when the object is positioned adjacent to the interactive display surface. Images or other files associated with the identifying characteristic are accessed and displayed on the interactive display surface. A gesture by a user adjacent to the interactive display surface is detected to reassociate a selected representation. For example, the user can change where the selected element fits in a sequence of data elements, or reassociate the selected element with a second object placed on the interactive display surface. In a networked environment, the reassociated element can be stored on a server and subsequently accessed from a different interactive surface via the network using the second physical object.
RELATED APPLICATIONS This application is a continuation-in-part of a patent application Ser. No. 10/867,876 filed on Jun. 15, 2004 now abandoned, the benefit of the filing date of which is hereby claimed under 35 U.S.C. � 120.
Exemplary Interactive Surface In FIG. 2, an exemplary interactive display table 60 is shown that includes the PC 20 within a frame 62 and which serves as both an optical input and video display device for the computer. In this cut-away figure of the interactive display table 60, rays of light 82 a-82 c used for displaying text and graphic images are generally illustrated using dotted lines, while rays of infrared (IR) light used for sensing objects on or just above a display surface 64 a of the interactive display table 60 are illustrated using dash lines. The display surface 64 a is set within an upper surface 64 of interactive display table 60. The perimeter of the table surface is useful for supporting a user's arms or other objects, including objects that may be used to interact with the graphic images or virtual environment being displayed on display surface 64 a. IR light sources 66 preferably comprise a plurality of IR light emitting diodes (LEDs) and are mounted on the interior side of frame 62. The IR light that is produced by IR light sources 66 is directed upwardly toward the underside of display surface 64 a, as indicated by dash lines 78 a, 78 b, and 78 c. The IR light from IR light sources 66 is reflected from any objects that are atop or proximate to the display surface after passing through a translucent layer 64 b of the table, comprising a sheet of vellum or other suitable translucent material with light diffusing properties. Although only one IR source 66 is shown, it will be appreciated that a plurality of such IR sources may be mounted at spaced-apart locations around the interior sides of frame 62 to prove an even illumination of display surface 64 a. The infrared light produced by the IR sources may:
Representations of Data Elements Associated with Physical Objects and Placement In FIG. 4A, an illustration 400 shows an exemplary environment 402 of an interactive display surface 404 of a computer system (not shown) executing a sorting application. Interactive display surface 404 supports a plurality of interactive applications including, for example, the sorting application, and other applications including, but not limited to, carousel and slideshow applications described below.
Reassociation of a Data Element with a Physical Object In accordance with embodiments of the present invention, data elements depicted as representations and associated with a physical object can be reassociated with the physical object or with a different physical object by user movements made adjacent the interactive display surface. FIGS. 5A and 5B show an embodiment of the present invention in which user movements are employed to enable the user to change associations of data-elements with a single physical object at a time. More particularly, FIGS. 5A and 5B show the user resequencing data elements in a carousel application (FIG. 4B), enabling a user to change how such data elements are presented in a slideshow application (FIG. 4C). One physical object may be used to access data elements, and then the data elements can be reassociated with a different physical object deployed in place of the original physical object, or the data elements associated with the original physical object may be rearranged, resequenced, or reassociated with the original physical object.
Reassociation of a Data Element with a Different Physical Object Embodiments of the present invention allow data elements to be reassociated with a single physical object or reassociated between a plurality of physical objects, as shown in FIGS. 6A-6D. FIG. 6A shows a sort mode environment 602 initiated by placing a physical object 604 on an interactive display surface 603 in a sort area 606. The sort mode causes representations 608 of data elements, which in this example, consist of images, to be presented in a grid over interactive display surface 603. Also disposed on interactive display surface 603 is a second physical object 612 with which data elements will be reassociated. In one embodiment of the present invention, second physical object 612 can be disposed at any desired location on interactive display surface 603. However, in other embodiments of the invention, a designated area may be presented on interactive display surface 603 where second physical object 612 is to be placed in order to have data elements reassociated with second physical object 612. Control icons 614 a, 614 b, and 614 c provide access to functions such as �UNDO,� �REDO,� and �EXIT,� respectively, that the user may wish to exercise in the course of the application.
Visually Confirming Reassociation of a Data Element In visually confirming reassociation of a data element by copying or moving, a reassociation animation may be applied to the representation of the reassociated data element. FIGS. 7A-7F show a plurality of reassociation animations that may be used. The reassociation animations may be selectively applied to correspond with certain types of user movements, as is described below.
Access of Data Elements Using a Physical Object at Another Location In reassociating data elements with physical objects, data elements are accessible via the same interactive display surface where the reassociation occurred. Furthermore, if the interactive display surface where the reassociation was conducted is in communication with a server via a network or a direct communication line, the reassociated data elements also may be accessible via another interactive display surface that is in communication with the server. Thus, by transporting the physical object with which data elements have been reassociated to a different interactive display surface, the reassociated data elements can be accessed from that different interactive display surface.
Flowchart for Presentation of Data Elements Associated with a Physical Object FIG. 9 is a flow diagram of a flowchart 900 illustrating the logical steps for presenting data elements associated with a physical object. Flowchart 900 commences at a step 902, where the interactive display surface waits for user input to commence execution of a program. At a step 904, a user places a physical object on the interactive display surface. The physical object presents a characteristic, such as a shape or an IR reflective identification pattern that can be identified by the interactive display surface, as previously described. At a decision step 906, it is determined if the characteristic presented by the physical object is identifiable. If not, flowchart 900 loops to step 902 for a physical object presenting an identifiable characteristic to be placed adjacent the interactive display surface. Alternatively, the user may be informed that the physical object presents no identifiable characteristic. As a further alternative, the user may be presented with an opportunity to register the characteristic presented by the physical object with the interactive display surface so that data elements may be associated with the physical object.
Flowchart for Reassociation of a Data Element with a Physical Object FIG. 10 is a flowchart 1000 illustrating the logical steps for facilitating reassociation of data elements associated with a physical object. Flowchart 1000 commences at a step 1002 like that of step 924 in flowchart 900 (FIG. 9), where the interactive display surface waits for user input regarding the representations of the data elements or the physical object presented on the interactive display surface. At a decision step 1004, it is determined if a pointing object is detected. The pointing object may include the user's hand or finger, or another physical object, possibly including an object presenting a characteristic or identification signifying its purpose to the interactive display surface as a pointing object.
Flowchart for Reassociation Animations Confirming Reassociation of a Data Element FIG. 11 illustrates the logical steps of a flowchart 1100 for presenting reassociation animations to signal or confirm reassociation of data elements. Flowchart 1100 embodies a function of an embodiment of the present invention in which the reassociating of representations of data elements is highlighted to both confirm the reassociation of data elements and to entertain the user. Flowchart 1100 may operate in cooperation with flowchart 1000 to highlight reassociation of data elements.
Flowchart for Storage of Reassociated Data Elements FIG. 12 is a flowchart 1200 for storing data elements associated with a physical object. As described in flowchart 1100 (FIG. 11), once a visual indication of reassociation of the representation depicting the data element has been performed, the data element depicted is reassociated. As described in connection with FIGS. 8A-8B, reassociation of the data element may involve reassociation in local storage and/or on a server accessible via a network, as is further described by flowchart 1200.
Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS4992650Mar 29, 1990Feb 12, 1991International Business Machines CorporationMethod and apparatus for barcode recognition in a digital imageUS6084590 *Oct 10, 1997Jul 4, 2000Synapix, Inc.Media production with correlation of image stream and abstract objects in a three-dimensional virtual stageUS6764185 *Aug 7, 2003Jul 20, 2004Mitsubishi Electric Research Laboratories, Inc.Projector as an input and output deviceUS20050245302 *Apr 29, 2004Nov 3, 2005Microsoft CorporationInteraction between objects and a virtual environment displayUS20050251800 *May 5, 2004Nov 10, 2005Microsoft CorporationInvoking applications with virtual objects on an interactive displayUS20060001645 *Jun 30, 2004Jan 5, 2006Microsoft CorporationUsing a physical object to control an attribute of an interactive display applicationUS20060001650 *Jun 30, 2004Jan 5, 2006Microsoft CorporationUsing physical objects to adjust attributes of an interactive display applicationUS20060007124 *Jun 28, 2004Jan 12, 2006Microsoft CorporationDisposing identifying codes on a user's hand to provide input to an interactive display applicationUS20060092170 *Oct 19, 2004May 4, 2006Microsoft CorporationUsing clear-coded, see-through objects to manipulate virtual objects* Cited by examinerNon-Patent CitationsReference1"3.6 Interpolation in Two or More Dimensions," Numerical Recipes in C: The Art of Scientific Computing. Chapter 3. Interpolation and Extrapolation. (C) 1988-1992, Cambridge University Press. Numerical Recipes Software. pp. 123-128.2"Bar Code 1, 2-Dimensional Bar Code Page." Available http://www.adams1.com/pub/russadam/stack.html. Printed Jan. 20, 2004. 14pp.3"DiamondSpin-Begs for Direct Manipulation Technology Is it the Pen? Sony Leaps Out-of-the-Box Again with Gummi." Mitsubishi/DiamondSpin. CHI 2004 #3. Printed Apr. 30, 2004. 5pp.4"IR Distance Sensor." Available http://www.diyelectronics.com/Accessories/IRDS.html (2pp) and http://www.diyelectronics.com/Accessories/GP2D05.html (1pg). Printed Dec. 30, 2003. 3pp.5"The Tablet PC A detailed look at Microsoft's proposed Tablet PC." Pen Computing Magazine: Tablet PC. Available http://www.pencomputing.com/frames/textblock<SUB>-</SUB>tablet<SUB>-</SUB>pc.html. Printed Dec. 30, 2003. pp. 1.6"VIRTUALBOARD." Available http://visilab.unime.it/visilab/virtualboard.htm. Printed Dec. 16, 2003. 6pp.7Ambiente article. "InteracTable(R)." Dated Jul. 7, 2000. Available http://www.darmstadt.gmd.de/ambiente/activities/interactable.html. Printed Nov. 21, 2003. 3pp.8Bier, Stone, Pier, Buston, and DeRose, "Toolglass and Magic Lenses: The See-Through Interface." Proceedings of Siggraph '93 (Anaheim, August). Computer Graphics Annual Conference Series, ACM, 1993, pp. 73-80. 8pp.9Blickenstorfer, Conrad H. "First Look: Acer TravelMate TM100 with Windows XP Tablet PC Edition." Pen Computing Magazine. Jul. 2002. pp. 44-47.10Dietz and Leigh. "DiamondTouch: A Multi-User Touch Technology." UIST '01 Orlando FLA. (C) ACM 2001 1-58113-438 -x/01/11. CHI Letters 3 (2). Nov. 11-14, 2001. pp. 219-226.11Electronic Check Alliance Processing, Inc. "Gift Cards, How Stored Value Card Systems Work." Available. http://www.electron-cap.com/GiftCards.htm. Printed Jan. 20, 2004 and May 16, 2004. (C) 2003. 2pp. total (3pp printed).12Fukuchi and Rekimoto. "Interaction Techniques for SmartSkin." ACM UIST2002 demonstration, 2002. 2pp.13Grabowski, Robert. "A Miniature Video Laser Range Finder for Small Robots." Available http://www.andrew.cmu.edu/~rjg/research/research<SUB>-</SUB>hardware/laser<SUB>-</SUB>rangefinder.html. Printed May 16, 2004. 8pp.14Grant and Winograd. "Flexible, Collaborative Organization on a Tabletop." ACM CSCW 2002: Workshop on Co-located Tabletop Collaboration: Technologies and Directions. New Orleans, LA. Nov. 2002. pp. 1-4.15Horn, Berthold K. P. "Robot Vision." The MIT Press. Available http://mitpress.mit.edu/catalog/item/default.asp?ttype=2&tid=8388. Printed Dec. 17, 2003. 6pp. total.16Horn, Berthold Klaus Paul. "Robot Vision." Binary Images: Topological Properties. The MIT Electrical Engineering and Computer Science Series. 1986. pp. 66-71 and cover page(s).17Hunter, Andrew. "Connected Components Analysis (Computer Vision)." www.google.com search results http://www.google.com/search?sourceid=navclient&q=connected+component+ellipse. Printed Mar. 7, 2004. Article dated Sep. 24, 2002. 2pp search results, 21pp article.18Ishii and Ullmer. "Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms." Proceedings of CHI '97, Mar. 22-27, 1997, Atlanta, Georgia. (C) 1997 ACM 0-89791-802-9/97/03. pp. 1-8.19Ishii, Wisneski, Orbanes, Chun, and Paradiso. "PingPongPlus: Design of an Athletic-Tangible Interface for Computer-Supported Cooperative Play." Proceedings of CHI '99, May 15-20, 1999, (C) 1999 ACM. pp. 1-8.20Johanson, Kolodny, and Russell. "A Hand pose and Position Tracker for the Interactive Table." CS223B Final Project. Available http://graphics.stanford.edu/~drussel/vision/tracker-report.html. Printed Dec. 16, 2003, 6pp.21Ju, Hurwitz, Judd, and Lee. "CounterActive: An Interactive Cookbook for the Kitchen Counter." Extended Abstracts of CHI 2001, Seattle. Apr. 2001. pp. 269-270.22Kang, Sing Bing. "Radial Distortion Snakes." IAPR Workshop on Machine Vision Applications (MVA2000), Tokyo, Japan. Nov. 2000. pp. 603-606.23Kato, Billinghurst, Poupyrev, Imamoto, and Tachibana. "Virtual Object Manipulation on a Table-Top AR Environment." IEEE and ACM Int'l Symposium on Augmented Reality 2000, ISAR'2000, Oct. 5-6, 2000, Munich. 9pp.24Klemmer, Newman, and Sapien. "The Designer's Outpost: A Task-Centered Tangible Interface for Web Site Information Design." Proceedings of Human Factors in Computing Systems: CHI 2000 Extended Abstracts. The Hague, The Netherlands. Apr. 1-6, 2000. pp. 333-334.25Klemmer, Newman, Farrell, Bilezikjian, and Landay. "The Designers' Outpost: A Tangible Interface for Collaborative Web Site Design." CHI Letters, The 14<SUP>th </SUP>Annual ACM Symposium on User Interface Soft Technology: UIST 2001. 3(2). pp. 1-10.26Kobayashi, Hirano, Narita, and Ishii. "A Tangible Interface for IP Network Simulation." CHI 2003, Apr. 5-10, 2003, Ft. Lauderdale, FL. ACM 1-58113-630-7/03/0004. 2pp.27Koike, Sato, and Kobayashi. "Integrating Paper and Digital Information on EnhancedDesk: A Method for Realtime Finger Tracking on an Augmented Desk System." ACM Transaction on Computer-Human Interaction, vol. 8 No. 4, Dec. 2001. (C) 2001 ACM 1073-0516/01/1200-0307. pp. 307-322.28Leibe, Starner, Ribarsky, Wartell, Krum, Singletary, and Hodges. "The Perceptive workbench: Toward Spontaneous and Natural Interaction In Semi-Immersive Virtual Environments." Proceedings of the IEEE Virtual Reality 2000 Conference, Mar. 18-22, 2000. New Brunswick, New Jersey: IEEE Computer Society, 2000. 8pp.29Leigh and Dietz. "DiamondTouch Characteristics and Capabilities." Mitsubishi Electric Research Laboratories, Cambridge, Massachusetts, USA. Undated. 2pp.30Magerkurth, Stenzel, and Prante. "STARS-A Ubiquitous Computing Platform for Computer Augmented Tabletop Games." 5<SUP>th </SUP>International Conference on Ubiquitous Computing (Ubicomp '03), Oct. 12-15, 2003, Seattle, Washington. 2pp.31Malandain, Gr�goire. "Connected Components Extraction." Available http://www-sop.inria.fr/epidaure/personnel/malandain/segment/connexe.html. Printed Dec. 18, 2003. 3pp.32Matsushita and Rekimoto. "HoloWall: Designing a Finger, Hand, Body, and Object Sensitive Wall." UIST '97 Banff, Alberta, Canada. (C) 1997 ACM 0-89791-881-9/97/10. pp. 209-210.33Missouri Department Of Revenue. "2D Barcode Technology." Undated. 3pp.34Moran, Saund, van Melle, Gujar, Fishkin, and Harrison. "Design and Technology for Collaborage; Collaborative Collages of Information on Physical Walls." UIST '99. Asheville, NC. (C) 1999 ACM 1-58113-075-9/99/11, CHI Letters vol. 1, 1. pp. 197-206.35Pangaro, Maynes-Aminzade, and Ishii. "The Actuated Workbench: Computer-Controlled Actuation in Tabletop Tangible Interfaces." Proceedings of UIST 2002, Oct. 27-30, 2002. (C) 2002 ACM. 10pp.36Paradiso, Hsiao, Strickon, Lifton, and Adler. "Sensor systems for interactive surfaces." IBM Systems Journal, vol. 39, Nos. 3&4, 2000. pp. 892-914.37Patten, Ishii, Hines, and Pangaro. "Sensetable: A Wireless Object Tracking Platform for Tangible User Interfaces." Proceedings of CHI 2001, Mar. 31-Apr. 5, 2001, ACM Press, (C) 2001 ACM. 8pp.38Patten, Recht, and Ishii. "Audiopad: A Tag-based Interface for Musical Performance." Proceedings of Conference on New Interface for Musical Expression (NIME '02). Dublin, Ireland, May 24-26, 2002. 6pp.39Ramos and Balakrishnan. "Fluid Interaction Techniques for the Control and Annotation of Digital Video." UIST '03 Vancouver, B.C., Canada. (C) 2003 ACM 1-58113-636-06/03/0010. pp. 105-114.40Rekimoto and Ayatsuka. "CyberCode: Designing Augmented Reality Environments with Visual Tags." Proc. of UIST 2000, 2000. 10pp.41Rekimoto and Matsushita. "Perceptual Surfaces: Towards a Human and Object Sensitive Interactive Display." Proceedings of Workshop on Perceptual User Interactes (PUI'97), 1997. 3pp.42Rekimoto and Nagao. "The World through the Computer: Computer Augmented Interaction with Real World Environments." Proceedings of UIST'95, 1995. pp. 29-36.43Rekimoto and Saitoh. "Augmented Surfaces: A Spatially Continuous Work Space for Hybrid Computing Environments." CHI '99, May 15-20, 1999. Pittsburgh, Pennsylvania. (C) ACM 1999 0-201-48559-1/99/05. pp. 378-385.44Rekimoto, Jun. "Matrix: A Realtime Object Identification and Registration Method for Augmented Reality." Proc. of Asia Pacific Computer Human Interaction (APCHI '98), 1998. 6pp.45Rekimoto, Jun. "Multiple-Computer User Interfaces: 'Beyond the Desktop' Direct Manipulation Environments." ACI CHI2000 Video Proceedings, 2000. 2pp.46Rekimoto, Jun. "Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments." Proceedings of UIST'97, 1997. pp. 31-39.47Rekimoto, Jun. "SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces." CHI 2002, Apr. 20-25, 2002, Minneapolis, Minnesota. (C) 2001 ACM 1-58113-453-3/02/0004. 8pp.48Rekimoto, Ullmer, and Oba. "DataTiles: A Modular Platform for Mixed Physical and Graphical Interactions." SIGCHI'01, Mar. 31-Apr. 4, 2001, Seattle, WA. (C) 2001 ACM 1-58113-327-8/01/0003. 8pp.49Reznik, Canny, and Alldrin. "Leaving on a Plane Jet." 2001 Int. Conf. on Intell. Robots & Systems (IROS), Maui, Hawaii, Oct. 2001. 6pp.50Ringel, Gerh, Jin, and Winograd. "Barehands: Implement-Free Interaction with a Wall-Mounted Display." Short Talks. CHI 2001 Mar. 31-Apr. 5 pp. 367-368.51Rosenfeld, Zawadzki, Sudol, and Perlin. "Planar Manipulator Display." New York University mrl. NYU Media Research Lab. Available http://cat.nyu.edu/PMD. Printed May 16, 2004. 3pp.52Rovani, David (Posted by). "My Second Month with the Compaq Tablet." Home>Reviews, TablePCHome.com-Table PC user community. Posted Apr. 10, 2003. Available http://www.tabletpchome.com/Messages.aspx?ThreadID=140. Printed Dec. 30, 2003. pp. 1-2 of 5.53Schmalstieg, Encarna��o, and Szalav�ri. "Using Transparent Props for Interaction With The Virtual Table." Presented at 1999 ACM Symposium on Interactive 3D Graphics (13DG '99). Apr. 26-28, 1999, Atlanta, GA. 7pp.54Scott, Grant, and Mandryk. "System Guidelines for Co-located collaborative Work on a Tabletop Display." Proceedings of ECSCW'03, European Conference Computer-Supported Cooperative Work 2003, Helsinki, Finland, Sep. 14-18, 2003. 20pp.55Shen, Everitt, and Ryall. "UbiTable: Impromptu Face-to-Face Collaboration on Horizontal Interactive Surfaces." (C) Mitsubishi Electric Research Laboratories, Inc., 2003. Cambridge, Massachusetts. TR-2003-49. Sep. 2003. 10pp.56Shen, Lesh, and Vernier. "Personal Digital Historian: Story Sharing Around the Table." Interactions. Mar. + Apr. 2003. pp. 15-22.57Shen, Lesh, Bernier, Forlines, and Frost. "Sharing and Building Digital Group Histories." CSCW'02, Nov. 16-20, 2002, New Orleans, Louisiana. (C) 2002 ACM 1-58113-560-2/02/0011. 10pp.58Shen, Lesh, Moghaddam, Beardsley, and Bardsley. "Personal Digital Historian: User Interface Design." (C) Mitsubishi Electric Research Laboratories, Inc. 2001. Cambridge, Massachusetts. 5pp.59Shen, Vernier, Forline, and Ringel. "DiamondSpin: An Extensible Toolkit for Around-the-Table Interaction." CHI 2004, Apr. 24-29, 2004, Vienna, Austria. (C) 2004 ACM 1-58113-702-8/04/0004. 8pp.60SMART Technologies Inc. White Paper. "DViT Digital Vision Touch Technology." Feb. 2003. 10pp.61Smart Technologies, Inc. "Rear Projection SMART Board(TM) Interactive Whiteboard" "SMART Board Software". Available http://www.smarttech.com/Products/rearprojection/index.asp and http://www.smarttech.com/Products/sbsoftware/index.asp. Printed Dec. 16, 2003. 5pp. total.62Starner, Leibe, Singletary, Lyons, Gandy, and Pair. "Towards Augmented Reality Gaming." Available http://www.gvu.gatech.edu/ccg/publications/imagina2000/. Printed Dec. 30, 2003. 27pp.63Streitz, Geibetaler, Holmer, Konomi, M�ller-Tomfelde, Reischl, Rexrogh, Seitz, and Steinmetz. "i-LAND: An interactive Landscape for Creativity and Innovation." Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI'99), Pittsburgh, Pennsylvania, May 15-20, 1999. ACM Press, New York. pp. 120-127.64Symanzik, J�rgen. "Three-Dimensional Statistical Graphics Based On Interactively Animated Anaglyphs." Published 1993. Available http://citeseer.mj.nec.com/95667.html. Printed Feb. 25, 2004. 7pp. total.65Tandler, Prante, M�ller-Tomfelde, Streitz, and Steinmetz. "ConnecTables: Dynamic Coupling of Displays for the Flexible Creation of Shared Workspaces." Proceedings of the 14. Annual ACM Symposium on User Interface Software and Technoic (USIT'01), ACM Press (CHI Letters 3 (2)), 2001, pp. 11-20 (10pp).66Ullmer and Ishii. "The metaDESK: Models and Prototypes for Tangible User Interfaces." Proceedings of UIST'97, Oct. 14-17, 1997. (C) ACM-ACM 0-89791-881-9/97/10. 10pp.67Ullmer, Ishii, and Glas. "mediaBlocks: Physical Containers, Transports, and Controls for Online Media." Computer Graphics Proceedings (SIGGRAPH'98), Jul. 19-24, 1998, (C) 1998 ACM. ACM-0-89791-999-8-8/98/007. 8pp.68Ullmer, Ishii, and Jacob. "Tangible query Interfaces: Physically Constrained Tokens for Manipulating Database Queries." Proc. INTERACT 2003 Conference, 2003. 11pp.69Underkoffler and Ishii. "Illuminating Light: An Optical Design Tool with a Luminous-Tangible Interface." Proceeding of CHI '98, Apr. 18-23, 1998, (C) 1998 ACM. pp. 1-8.70Underkoffler and Ishii. "Urp: A Luminous-Tangible Workbench for Urban Planning and Design." Proceedings of CHI '99. May 15-20, 1999. (C) 1998 ACM. pp. 1-8.71Underkoffler, Ullmer, and Ishii. "Emancipated Pixels: Real-World Graphics in the Luminous Room." Proceedings of SIGGRAPH '99, Aug. 8-13, 1999, (C) 1999 ACM. 8pp.72Vernier, Lesh, and Shen. "Visualization Techniques for Circular Tabletop Interfaces." To appear in Advanced Visual Interfaces, May 2002, Trento, Italy. (C) 2002 Mitsubishi Electric Research Laboratories, Inc. MERL-TR2002-01. Authored Mar. 2002. 10pp.73Viola and Jones. "Robust Real-time Object Detection." Cambridge Research Laboratory, Technical Report Series. Compaq. CRL 2001/01, Feb. 2001. 30pp.74Von Hardenberg and B�rard. Bare-Hand Human-Computer Interaction. PUI 2001 Orlando, FL, (C) 2001 ACM 1-58113-448-7-11/14/01. 8pp.75Wellner, Pierre. "Interacting with Paper on the DigitalDesk." Communications of the ACM. Jul. 1993. EuroPARC tech report EPC-93-195. 17pp.76Whalen, Tara. "Playing well with Others: Applying Board Game Design to Tabletop Display Interfaces." UIST 2003. Vancouver, Nov. 2-5, 2003, 3pp.77Wu and Balakrishnan. "Multi-Finger and Whole Hand Gestural Interaction Techniques for Multi-User Tabletop Displays." UIST '03, Vancouver, B.C., Canada. (C) 2003 ACM 1-58113-636-6/03/0010. pp. 193-202.Referenced byCiting PatentFiling datePublication dateApplicantTitleUS7762671 *Oct 14, 2005Jul 27, 2010Casio Computer Co., Ltd.Projector apparatus, display output method and display output programUS7924271 *Jun 13, 2007Apr 12, 2011Apple Inc.Detecting gestures on multi-event sensitive devicesUS7930642Mar 20, 2008Apr 19, 2011Intuit Inc.System and method for interacting with hard copy documentsUS7987423 *Oct 11, 2006Jul 26, 2011Hewlett-Packard Development Company, L.P.Personalized slide show generationUS8199117 *May 9, 2007Jun 12, 2012Microsoft CorporationArchive for physical and digital objectsUS8412584 *Apr 29, 2011Apr 2, 2013Microsoft CorporationVirtual features of physical itemsUS8468463 *Nov 16, 2007Jun 18, 2013Fuji Xerox Co., Ltd.Image processing apparatus, image processing method and computer readable mediumUS8584029May 23, 2008Nov 12, 2013Intuit Inc.Surface computer system and method for integrating display of user interface with physical objectsUS20110205246 *Apr 29, 2011Aug 25, 2011Microsoft CorporationVirtual features of physical itemsUS20110307815 *Jun 11, 2010Dec 15, 2011Mygobs OyUser Interface and Method for Collecting Preference Data GraphicallyUS20120137259 *Mar 26, 2010May 31, 2012Robert CampbellAssociated file* Cited by examinerClassifications U.S. Classification345/173, 345/156International ClassificationG09G5/00, G06F3/041, G06T17/00, G06F3/042, G06F3/01Cooperative ClassificationG06F3/011, G06F3/014, G06F3/042European ClassificationG06F3/01B, G06F3/042, G06F3/01B6Legal EventsDateCodeEventDescriptionSep 14, 2011FPAYFee paymentYear of fee payment: 4Dec 27, 2004ASAssignmentOwner name: MICROSOFT CORPORATION, WASHINGTONFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:DEHLIN, JOEL P.;DRUCKER, STEVEN M.;WONG, CURTIS GLENN;AND OTHERS;REEL/FRAME:015490/0040;SIGNING DATES FROM 20041026 TO 20041119RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services©2012 Google