Patent ID: 7982751

Claim:
A method for controlling a computer using at least one video image of a plurality of video images, the method comprising: (a) capturing n video streams, n being an integer of at least two, the n video streams each comprising a plurality of video frames and each of the n video streams comprising video of a different user; (b) determining a location of an object in at least one of the n video streams; (c) controlling a program executing on the computer based on the location of the object; (d) combining, at a single computer, the n video streams with a user interface stream generated by a computer operating system, thereby forming a composite video stream; (e) providing the composite video stream for display to each of the different users; and (f) displaying the composite video stream, wherein displaying the composite video stream includes displaying images of the different users on or behind a desktop interface and allowing the images of the different users to interact with desktop contents.