Patent ID: 8392450

Claim:
A computer-implemented method for generating relevant augment information based on user profiles, the method comprising: storing user profile information for a plurality of mobile computing devices in a user profile database accessible from a network; receiving identity information from a first mobile computing device connected to the network using wireless communication, the identity information corresponding to a user profile associated with the first mobile computing device; decomposing one or more objects contained in a first frame into geometric shapes and identifying other visual distinctive features of the one or more objects to assist in determining points of interest contained within the first frame; decomposing one or more objects contained in a second frame into geometric shapes and identifying other visual distinctive features of the one or more objects to assist in determining the points of interest contained within the second frame; relating patterns from a series of frames, including the first and second frames, in a video stream to assist in determining the points of interest contained within each of the series of frames; receiving characteristics information on the points of interest included in the series of frames of the video stream being captured by the first mobile computing device and geographic information associated with the series of frames of the video stream from the first mobile computing device using wireless communication, where the characteristics information of the points of interest at least include patterns of the geometric shapes and the other distinctive visual features and combining the characteristics information and the geographical information to match to characteristics of objects that are stored in an object database in order to identify the points of interest captured in the video stream; selecting relevant augment information from an augment information database coupled with the user profile database, wherein the relevant augment information is selected based on the user profile associated with the first mobile computing device; and using the relevant augment information in the first mobile computing device to enable 1) overlaying, 2) highlighting, or 3) combination, of the points of interest in the series of frames of the video stream with the relevant augment information.