Patent Publication Number: US-10783528-B2

Title: Targeted marketing system and method

Description:
CROSS-REFERENCE TO RELATED APPLICATIONS 
     This application is a continuation-in-part of U.S. patent application Ser. No. 13/407,749, filed Feb. 28, 2012, which is a continuation-in-part of U.S. patent application Ser. No. 12/033,885, filed Feb. 19, 2008, which is a continuation-in-part of U.S. patent application Ser. No. 09/645,292, filed Aug. 24, 2000, issued as U.S. Pat. No. 7,337,127, all of which are incorporated by reference herein in their entirety for all purposes. U.S. patent application Ser. No. 13/407,749 claims priority to U.S. Provisional Application Ser. No. 61/447,698, filed Feb. 28, 2011, which is incorporated by reference herein in its entirety for all purposes. This application claims priority to U.S. Provisional Application Ser. No. 61/470,481, filed Mar. 31, 2011 which is incorporated by reference herein in its entirety for all purposes. This application is a continuation-in-part of U.S. patent application Ser. No. 12/714,518, filed on Aug. 10, 2010, which claims priority to U.S. Provisional Application No. 61/156,537, filed on Mar. 7, 2010, both or which are incorporated by reference herein in their entireties for all purposes. 
    
    
     BACKGROUND OF THE INVENTION 
     1. Field of the Invention 
     The present invention relates to targeted marketing, and in particular to systems and methods for personalizing marketing materials, advertisements, entertainment, educational materials, and other content to the individual preferences of Internet users. 
     2. Description of Related Art 
     Targeted marketing through the Internet is well known in the art. Individuals who navigate the World Wide Web (“Web”) portion of the Internet are frequently presented with advertisements, promotions, and other content (collectively “content”) targeted to their demographic and psychographic attributes, and other individual preferences and characteristics. In a typical scenario, an advertiser, promoter or other entity (collectively “content provider”) selects a set of target demographics and/or psychographics (“target profile”) for its content and makes the content accessible to Internet users through a Web site. The Web site operator, or another affiliated entity, maintains a user profile for each of its registered (or otherwise identifiable) users. Each user profile includes data fields for storing known attributes of its associated user, which may include name, address, telephone number, e-mail address, gender, age, race, and other personal information. When an individual accesses a Web site that includes a plurality of targeted content, the individual&#39;s user profile is compared against the target profile for the available targeted content, and the targeted content having a target profile that best fits the individual is displayed to the individual on the Web page. 
     The effectiveness of targeted marketing often depends on the quantity and quality of data collected for each user. For example, a primary source of user data is an online survey or questionnaire. Many Web sites require new users to establish an online profile before permitting access to certain Web pages or services. Each new user is prompted to provide the user&#39;s name, address, telephone number, gender, age, e-mail address and other demographic information. However, many users are reluctant to provide such private information over the Internet and set up “dummy” profiles with false data. Further, users are often reluctant to fill out a lengthy questionnaire that requires detailed answers, thus limiting the amount and type of information collected through this approach. 
     Additional user information is often collected by tracking the occurrence of certain user-initiated events. For example, one common approach creates a log entry each time a user clicks through a displayed advertisement. Each user&#39;s online purchases made through the Web site may also be logged in the user profile. These events may be tracked through server-based programs and/or software executing on the user&#39;s computer. The data collected through these approaches is typically limited to a small subset of the user&#39;s actual online behavior, and attempts to correlate this behavioral data with user psychographics have proven to be inadequate. 
     In view of these and other limitations in the prior art, there is a need for a targeted marketing system and method that collects detailed and accurate user profile data and matches user profile data to target demographic and psychographic attributes in a meaningful manner. Further, there is a need for a way to use such collected data to create and provide advertisements, promotions or other content that will attract the user&#39;s attention. 
     SUMMARY OF THE INVENTION 
     The present invention provides a system and method for delivering targeted marketing to online Internet users, including users of mobile phone technologies, personal digital assistants (“PDA”), iTV applications, instant messaging applications, multimedia messaging applications, short messaging applications (such as text messaging applications) or any similar technology where data is downloaded from interconnected servers. In a preferred embodiment, psychometric information and a photographic likeness of a user are collected for use in personalizing marketing, advertising, entertainment, educational materials and other content. 
     In a preferred embodiment, at least one Web server and at least one network device are connected through a network, such as the Internet. The Web server may be any computing device that provides World Wide Web services on the Internet, and the network device may be any device that is adapted to access and navigate Web pages from the Web server through the Internet. Each user of the Web server registers through a registration Web page, which queries the user for basic demographic information such as name, address, telephone number, age, gender and income. The user registration includes the creation of a user profile, which is used by the Web server to store data associated with the registered user. 
     A preferred user profile includes initial survey responses provided by the user during registration, data describing the user&#39;s Web browsing habits and Web purchasing patterns, a photographic likeness of the user, context-specific survey responses and random survey responses. The user profile is analyzed to prepare a summary of the user&#39;s personality, buying motives, interests, activities, opinions and other characteristics. 
     The user&#39;s actions on each Web page provide insights into the user&#39;s preferences for the content available on the Web page. Each Web page includes one or more pieces of content, which may include text articles, banner ads, pictures, videos, audio files, etc. The Web site operator, advertiser, or other entity may select zero or more market segmentation variables to be associated with each piece of content, and assign metrics to be given upon the occurrence of each action. The assigned metric value depends on various factors such as the user action and the number of times this user action has been recorded for the particular content. The data stored in the user profile, such as the user&#39;s demographic and psychographic data, may also include an associated confidence factor that reduces the value of a metric, or the weight given to a data element, over time. 
     In a preferred embodiment, the user is encouraged to transmit the user&#39;s photographic likeness to the Web server for storage in the user&#39;s profile. Each image preferably includes a picture of the user&#39;s head and shoulders, full body or ownership item against a solid background. The photographic likeness is processed by converting the image to a standard image format, and then identifying facial features and outline, body features and outline or features and outlines of their ownership items from the image. Additional data is also collected from the picture for storage in the user profile such as the user&#39;s hair color, eye color, skin tone, face shape, body type and other information that may be derived from the photographic image. 
     Context-specific survey questions and random survey questions are asked periodically to verify weak data elements or supply missing data elements. These survey questions are less intrusive than a lengthy questionnaire and can be used throughout the Web site to gather information. In a preferred embodiment, the user profiles are analyzed in view of the target demographics and psychographics of the available content to identify data elements that have generally weak confidence factors or are otherwise deficient for use in accurately targeting the available content. The market researcher is then notified of the deficiencies in the data and a search is conducted to locate content having an associated market segmentation variable that relates to the deficient data element. Next, the market researcher is prompted to develop a context-specific survey question that relates to the content, the answer to which supplies the deficient data element. The market researcher is also prompted to develop a random survey question, the answer to which supplies to the deficient data element. Random questions may be presented to the user periodically, even while the user is viewing unrelated content. 
     The collected data in the user profile is also used to target specific content to the user. When selecting content to display to the user, the Web server automatically selects the content with target demographics and psychographics that best matches the user&#39;s data index calculated from the user profile. In addition, on certain Web pages, content that best matches the user&#39;s data index may be displayed more prominently to the user than other content displayed on the Web page. 
     The user profile may also be used to create personalized advertisements, marketing materials, entertainment, or educational materials for an individual user. For example, the user&#39;s likeness may be altered to reflect the approximate look of specific jewelry, accessories, hairstyles, cuts and coloring, clothing, cosmetics applications, including but not limited to eyebrow pencils, foundations and concealers, the effects of cosmetic applications, including but not limited to cosmetic moisturizers, hair styling products, and self tanning applications, cosmetic procedures, weight loss programs, and other items. The altered image may then be displayed to the user as part of a Web page, print advertisement, email, instant messaging (“IM”), mobile multimedia messaging systems (“MMS”), short messaging systems, or other content on the user&#39;s computer, cell phone, PDA, or any other similar electronic device. Clothing may be illustrated on a body image that closely matches the user&#39;s body measurements (or clothing sizes) recorded in the user profile. The user&#39;s likeness may also be altered to simulate the user in different locations, anatomical poses, and video or audio situations. 
     A more complete understanding of the Targeted Marketing System and Method will be afforded to those skilled in the art, as well as a realization of additional advantages and objects thereof, by a consideration of the following detailed description of preferred embodiments. Reference will be made to the appended sheets of drawings, which will first be described briefly. 
    
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         FIG. 1  illustrates a preferred environment for operating the present invention; 
         FIG. 2  is a block diagram illustrating the components of a preferred web server; 
         FIG. 3  is a block diagram illustrating the components of a preferred network device; 
         FIG. 4  illustrates a preferred embodiment of user profile data; 
         FIG. 5  illustrates a preferred database table used for logging user initiated events; 
         FIG. 6  illustrates an exemplary profile of an individual user stored in the data storage in a preferred embodiment. 
         FIG. 7  illustrates the assignment of metric values to user initiated events in a preferred embodiment; 
         FIGS. 8 a - d    illustrate a preferred processing of a photographic likeness; 
         FIG. 9  illustrates a preferred method for targeting to a user marketing content relevant to the user&#39;s ownership item; 
         FIG. 10  illustrates a preferred system for targeting to a user marketing content relevant to the user&#39;s ownership item; 
         FIG. 11  is a flow diagram illustrating the preferred steps in creating context-sensitive and random survey questions; 
         FIG. 12  is a flow diagram illustrating the preferred step of analyzing user profile data; 
         FIG. 13  illustrates one example of the incorporation of a photographic likeness into content; and 
         FIG. 14  illustrates an example of altering the photographic likeness of an ownership item of the user. 
         FIG. 15  illustrates an example of altering the photographic likeness of an ownership item of the user. 
         FIG. 16  illustrates an example of altering the photographic likeness of an ownership item of the user. 
         FIG. 17  illustrates an example of altering the photographic likeness of an ownership item of the user. 
         FIG. 18  illustrates an example of altering the photographic likeness of an ownership item of the user. 
         FIG. 19  illustrates an example of altering the photographic likeness of an ownership item of the user. 
         FIG. 20  illustrates an example of altering the photographic likeness of an ownership item of the user. 
         FIG. 21  illustrates an example of altering the photographic likeness of an ownership item of the user. 
         FIG. 22  illustrates an example of altering the photographic likeness of an ownership item of the user. 
         FIG. 23  illustrates an example of altering the photographic likeness of an ownership item of the user. 
         FIG. 24  illustrates an example of altering the photographic likeness of an ownership item of the user. 
         FIG. 25  illustrates an example of altering a color in the photographic likeness of a user. 
         FIG. 26  is a flow diagram for a process for the selection of a color to alter the photographic likeness of a user or a user&#39;s ownership item. 
         FIG. 27  illustrates an example of altering the photographic likeness of a user or of an ownership item of a user by applying a transformation related to an interactive advertisement presented to the user. 
         FIG. 28  illustrates an example of altering the photographic likeness of a user or an ownership item of a user by applying a transformation related to a user&#39;s search for products and services. 
         FIG. 29  illustrates an example of altering the photographic likeness of a user or of an ownership item of a user. 
         FIG. 30  illustrates an example of a simulated virtual retail space, according to some embodiments of the invention. 
     
    
    
     DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
     The present invention provides a system and method for delivering targeted marketing to online/Internet users, including users of mobile phone technologies, personal digital assistants (“PDA”), iTV applications, instant messaging applications, multimedia messaging applications, short messaging applications (such as text messaging applications) or any similar technology where data is downloaded from interconnected servers. In a preferred embodiment, psychometric information and a photographic likeness or illustrated image of a user are collected at a database for use in personalizing marketing, advertising, entertainment and educational materials, and other content (collectively “content”). In the detailed description that follows, like element numerals are used to describe like elements illustrated in one or more of the aforementioned figures. 
     A preferred embodiment of the present invention is illustrated in  FIG. 1 , and includes at least one Web server  10  and at least one network device  30  connected through a network  20 , such as the Internet. The network device  30  may be any client device such as a personal computer, laptop computer, handheld computer, mainframe computer, PDA, smartphone, mobile device, netbook or any other device capable of computing, data processing or the like. Alternatively, the network device  30  may be a thin client with all of the processing done remotely. The Web server  10  may be any computing device that provides World Wide Web services on the Internet. As illustrated in  FIG. 2 , the Web server  10  preferably includes a processor  12 , a program memory  14  for storing program instructions, and a data storage  16  for storing targeted content, Web pages, user profile data and other targeted marketing information. The features of the Web server  10  described herein may be embodied on a plurality of computing devices, which may reside in a plurality of locations. The network device  30  is adapted to access and navigate Web pages from the Web server  10  through the Internet  20 , and may include a personal computer, a Wireless Application Protocol telephone, or an Internet appliance. As illustrated in  FIG. 3 , the network device  30  preferably includes a processor  32 , a memory  34 , a display  36  and an input device  38  such as a mouse and a keyboard. 
     In operation, a user of the network device  30  accesses Web pages stored on the Web server  10  through a browser application. As known in the art, the Web server  10  may be accessed by entering its Uniform Resource Locator (“URL”) into the Web browser. The Web server  10  preferably includes a home page providing links to other user accessible Web pages on the Web server  10 , a registration Web page for collecting user profile information from new users, a login Web page for identifying registered users, and stored content. The stored content may include articles, pictures, advertisements, promotions, products and services offered for sale, and other targeted content. In a preferred embodiment, each user is required to register with Web server  10  in order to gain access to certain content stored on the Web server  10 . A new user is registered through the registration page, which queries the user for basic demographic information such as name, address, telephone number, age, gender and income. In subsequent visits to the Web server  10 , the user may be identified by the Web server  10  through the use of a user name and password, through cookies stored on the network device  30 , or any other identification method that links the user to stored data associated with the user. 
     The user registration includes the creation of a user profile, which is used by the Web server  10  to store data associated with the registered user. As illustrated in  FIG. 4 , a preferred user profile data  50  includes initial survey responses  52  provided by the user during registration, data describing the user&#39;s browsing habits  54  and purchasing patterns  56 , a photographic likeness of the user  58 , context-specific survey responses  60 , random survey responses  62 , and data from product and service trials on and interaction with the photographic likeness  64 . 
     The photographic likeness of the user  58  can be, e.g., the user&#39;s photograph or a photographic likeness, including a cartoon likeness or a caricature that is built either by the user employing a photographic-likeness-building software or built by software using information collected from the user (e.g., the user may provide information regarding facial characteristics and hairstyle and/or body type when registering or in response to survey questions and this information can be used by the computer program to build the photographic likeness). 
     The data from trials and interaction with photographic likeness  64  is obtained, for example, by tracking all of the user&#39;s “try on” data, e.g., data collected from the user&#39;s interaction with their photographic likeness. By example, every lipstick color or product that a user may have experimented with or “tried” on their own image, or every tie that a user tried on with a suit is tracked and stored in a database. Profiling and predictive modeling systems utilize the user&#39;s explicit and implicit preferences to market back those goods and services back to the user on their own image by altering that image. 
     The data collected in the user profile data  50  is analyzed by the Web server  10  to identify the user&#39;s preferences, purchasing habits and computer operation proficiency. The multiple user profiles are analyzed to identify trends and spending habits of the aggregate user group, a subgroup based on various demographic elements, or unique user data. In addition, the user profile data  50  can include a photographic likeness or illustrated image of ownership items of the user  59  (the photographic likeness can be a photograph itself or a likeness built either by the user employing a photographic-likeness-building software or built by software using information collected from the user). Examples of ownership items of the user include, e.g., home exteriors (e.g., the user is given a preview of the home painted a different color, with a new front door, or with new shutters); home interiors (e.g., the user is given a preview of the interior walls of a room painted various colors, the room with different types of floorings installed such as, e.g., hardwood, tile, or carpet; the interior walls of the room arranged with various paintings; or the room arranged with various furniture) (an example is provided in  FIG. 14 ); automobiles (e.g., the user is given a preview of his or her automobile, or desired automobile, with optional equipment installed; or a preview of the automobile painted various colors) (an example is provided in  FIG. 17 ); landscape (e.g., the user is given a preview of the lawn with the addition of new shrubs, or a preview of the yard planted with a different type of grass); pets (e.g., the user is given a preview of his or her pet dressed in clothing such as, e.g., a sweater) (an example is provided in  FIG. 20 ); new makeovers, makeup, hairstyles and fashion accessories (an example is provided in  FIGS. 15, 16, 18, 19, 21 , and  22 ); changes in physical appearance of the user (an example is provided in  FIGS. 23 and 24 ); and family or individual family members (e.g. the user is presented with a preview of their family on vacation in Hawaii in a beach scene, or a preview of the family in matching pajamas, or a preview of the family sitting outside of their new home, or a preview of a family member in ski wear and goggles/sunglasses at a ski resort). 
     In some embodiments, data collected in user profile data  50  is analyzed based on user profiling and predictive modeling to market goods and services to the user that may be of interest to the user based on the user&#39;s previous interactions. Input from human consultants may be incorporated in the analysis of user profile data  50  to create a user-specific experience. 
     In a preferred embodiment, after a user logs onto the Web server  10 , the user&#39;s actions are tracked until the user logs off or leaves the Web site, either manually or by tracking software known in the art. The user may be tracked by detecting user initiated requests at the Web server  10 , by detecting user initiated events through software executing on the user&#39;s network device  30  and then transmitting the logged events to the Web server  10 , or by other methods known in the art.  FIG. 5  illustrates a preferred database table for storing the data describing the user&#39;s browsing habits  54 . The table includes a sequence of events and the date and time at which each event was detected. The user initiated events that may be tracked include, but are not limited to, selecting a link to a Web page, selecting a link to another Web page, clicking through an advertisement, products and services the user “tries” and experiments with, including Web browsing and survey responses, and printing the current Web page. The user&#39;s Web purchases  56  may be tracked in a similar manner, i.e., by logging the date, time and amount of the purchase, an item identifier, the quantity purchased, payment method and shipping address. In addition, the content (e.g., products or services) selected by the user for incorporation within the photographic likeness of the user or the photographic likeness of the user&#39;s ownership item may also be tracked. By tracking the content applied to the photographic likeness, the user&#39;s preferences are implicitly obtained. 
     The data describing the user&#39;s browsing habits  54 , along with the other data from the user profile data  50 , is analyzed to prepare a profile of the user&#39;s personality, buying motives, interests, activities, opinions and other characteristics.  FIG. 6  illustrates an exemplary individual user profile  250  stored in the data storage  16  in a preferred embodiment. The individual user profile  250  includes, e.g., statistics of the individual user (e.g., gender, age group, and hair color), lipstick statistics (e.g., lipstick color preference and lipstick vendor preference), and jewelry statistics (e.g., favorite jewelry and favorite precious stone). The statistics can be obtained from explicit preference indications (e.g., the user&#39;s responses to survey or registration questions) or based on implicit preference indications (e.g., tracking the number of times the user asks that a certain type of product (e.g., Sephora red lipstick) or procedure be applied to their photographic likeness). The detailed individual user profile  250  facilitates the marketing of products targeted to the individual user based on the individual user&#39;s preferences expressed either explicitly or implicitly. 
     In a preferred embodiment, market segmentation variables are pre-selected by the content providers based on the target demographics and psychographics each content provider is attempting to reach. The user profile data  50  is then analyzed to determine user values for each of these pre-selected market segmentation variables. For example, the content provider may target its content to a particular Value and Lifestyle Survey (VALS) category. As known in the art, VALS places consumers into one of nine mutually exclusive lifestyle categories based on their psychology and key demographics. These categories have been found to be strong predictors of a variety of consumer preferences in products, services, and media. Other psychographic market segmentation variables may also be used, such as variables describing personality traits (e.g., reserved v. outgoing; dull v. bright; trusting v. suspicious). 
     A preferred analysis of the data describing the user&#39;s browsing habits  54  will now be described with reference to  FIG. 7 . Each Web page  70  includes one or more pieces of content  72 , which may include text articles, banner ads, pictures, videos, audio files, etc. The user&#39;s actions  74  on the Web page  70  provide insights into the user&#39;s preferences for the content  72  available on the Web page  70 . For example, if the user immediately hits the “Back” button on the user&#39;s browser when the Web page  70  is displayed (e.g., the time spent on the Web page  70  is less than a predetermined value X), it could indicate that the user has little interest in the displayed content  72 . The web site operator, advertiser, or other entity may select zero or more market segmentation variables  76  to be associated with each piece of content  72 . This selection is preferably performed manually by a market researcher to determine the market segmentation variables  76  to associate with the content  72 , and the values to give the metrics  78  upon the occurrence of each action. Alternatively, this selection may be performed electronically through market research software known in the art. In a preferred embodiment, each market segmentation variable has a metric value from 0 to +100 that indicates the value of the user action for that market segmentation variable. The assigned metric value may depend on various factors such as the user action and the number of times this user action has been recorded for the particular content. 
     The data stored in the user profile data  50 , such as the user&#39;s demographic and psychographic data, may also include an associated confidence factor. In a preferred embodiment, the confidence factor is a decay function that reduces the value of a metric, or the weight given to a data element, over time. A market researcher preferably sets the confidence factor for each data element based on the type of data and the researcher&#39;s confidence in the data source. For example, there may be a high level of confidence in a residential address entered by a user for the delivery of items purchased online. In such a scenario the market researcher may remain confident in the accuracy of the address more than one year from the date of entry, and may set the confidence in the data to be reduced 10% every year. The market researcher may have a much lower level of confidence in other data, for example, the user&#39;s “favorite movie.” Because a user&#39;s favorite movie may change frequently over time, the market researcher may set the confidence level to be reduced more often, for example, a reduction of 50% every three months. 
     As discussed above, the user is encouraged to transmit the user&#39;s photographic likeness  58  or photographic likeness of ownership items of the user  59  to the Web server  10  for storage in the user&#39;s profile  50 . If the photographic likenesses  58  and  59  are computer graphics files (e.g., JPEG or GIF) then the user may email or otherwise transmit the graphics file to the Web server  10 . In a preferred embodiment, the user may alternatively send a photograph to the Web site operator who will create a digital image of the photograph for storage in the user profile. In addition, the user&#39;s photograph may be taken using a mobile device such as a cell phone camera, PDA, or any other similar electronic device whereby the image can be transmitted wirelessly to the Web server  10  for storage. Alternatively, the photographic likeness can be built by the user by employing photographic-likeness-building software, or built by software using data collected from the user (e.g., a computer program can gather their facial characteristics and hairstyle information when they register or when responding to survey questions). The photographic likenesses  58  and  59  are processed according to the preferred steps illustrated in  FIG. 8   a.    
     In Step  80 , the photographic image is converted to a standard image format. In the preferred embodiment, each image includes a picture of the user&#39;s head and shoulders, against a solid background, as illustrated in  FIG. 8 b   . Alternatively, the image can include the entire body as shown in  FIG. 8 c   . Step  80  may include cropping the image and changing the file size, image dimensions, number of colors and file type. In Step  82 , the features of the face or entire body in the photographic likeness  58  are identified. In the preferred embodiment, the location of the user&#39;s eyes, eyelids, cheeks, ears, lips, neckline, hairline and other facial features are identified on the two-dimensional image and stored in the user profile data  50 . For example, the user&#39;s lips can be identified and their size determined from the photographic likeness and if the lips are determined to be small, then the photographic likeness can be altered to demonstrate the user&#39;s lips enhanced by a new lip plumping lipstick. Similarly, age spots can be identified on the user&#39;s photographic likeness and foundation concealer from a particular company can be applied to cover those age spots. In this way, results of a product or the effects of a treatment such as a laser treatment that removes the spots can be immediately visualized. Also, the user&#39;s hairline can be identified on the photographic likeness and if it&#39;s determined that the user is balding or otherwise losing hair, then the photographic likeness can be altered to demonstrate hair growth resulting from use of hair restoration products from companies such as, e.g., Bosley Medical. The user profile data may also store any other applicable physical feature of the user. The identification step may be performed manually by a graphics editor, or automatically through facial feature recognition software known in the art. Optionally, the identification by the software can be adjusted manually by the user thus overriding the identification performed by the software. For example, the eye lid area identified by the software can be manually adjusted by the user so that cosmetics for the eye lid is applied only to the area defined by the user. By identifying physical characteristics from the user&#39;s photographic likeness, characteristics of the user can be obtained even if the user doesn&#39;t respond to survey questions. Metrics can be assigned to the identified physical characteristics. In Step  84 , additional data is collected from the picture for storage in the user profile data  50 . For example, the user&#39;s hair color, eye color, skin tone, face shape, and other information that may be manually determined from the photographic image and recorded in the user profile data  50 . 
     Alternatively, the image can include can include any ownership item, such as the interior of a room as shown in  FIG. 8 d   . As before, step  80  may include cropping the image and changing the file size, image dimensions, number of colors and file type. In Step  82 , the features of the ownership item in the photographic likeness  59  are identified. As before, the user profile data may also store any other applicable physical feature of the structure or ownership item. The identification step may be performed manually by a graphics editor, or automatically through feature recognition software known in the art. Optionally, the identification by the software can be adjusted manually by the user thus overriding the identification performed by the software. By identifying physical characteristics from the user&#39;s photographic likeness  59 , characteristics of the ownership item can be obtained even if the user doesn&#39;t respond to survey questions. Metrics can be assigned to the identified physical characteristics. In Step  84 , additional data is collected from the picture for storage in the user profile data  50 . For example, color, shape, structure, and other information that may be manually determined from the photographic image and recorded in the user profile data  50 . 
       FIG. 9  illustrates a preferred method for targeting to the user marketing content relevant to the ownership item. In block  203 , the photographic likeness is converted to a standard image format. The conversion may include cropping the image and changing the file size, image dimensions, number of colors, and file type. In block  206 , data elements are collected and stored in the user profile  50 . The data elements can be, e.g., the initial survey responses  52 , the context-specific survey responses  60 , the random survey responses  62 , the browsing habits  54 , the purchasing patterns  56 , the trials and interactions with the photographic likeness  64  and the photographic likeness of the user  58  and/or the photographic likeness of the user&#39;s ownership item  59 . The photographic likeness can be collected using various techniques. For example, if the photographic likeness of the ownership item  59  is a computer graphics file (e.g., JPEG or GIF) then the user may email or otherwise transmit the graphics file to the Web server  10 . Alternatively, the user may send a photograph of the ownership item to the Web site operator who will create a digital image of the photograph for storage in the user profile. In addition, the user may take a photograph of the ownership item using their camera cell phone or other mobile device and transmit the photograph wirelessly to the Web server  10  for storage. Alternatively, the photographic likeness of the ownership item of the user  59  can be built by the user by employing the photographic-likeness-building software (e.g., software can be used to build the user&#39;s room by the user himself or herself to create a visual likeness of their room, or can be built through the data gathered by the user registering or interacting with the surveys and experimenting with different products in the software). As another alternative, photographic likeness  59  can be built by software using data gathered from the user (e.g., the information collected during registration or by tracking can be used to build the photographic likeness of the ownership item). In yet another embodiment, photographic likeness  59  of other ownership items such as pets, jewelry, accessories, etc. can be built using similar software modules. 
     In block  209 , the photographic likeness of the user&#39;s ownership item is processed. The processing includes identifying the characteristics of the ownership item in the photographic likeness. This step may be performed manually by a graphics editor, or automatically through feature recognition software known in the art. For example, the number of doors on the automobile or the location of the doors or seats on the automobile, or the color of the walls of a room or the location of the edges of the wall are identified on the two-dimensional image and stored in the user profile data  50 . In block  212 , the identified characteristics are added to the user profile  50 . 
     In block  215 , the user profile  50  is compared with a target profile associated with each content to select content that best matches the user profile. The data elements in the user profile  50  can be assigned metrics and algorithms and these metrics and algorithms are applied to the corresponding market segmentation variables to generate data indices. The data indices indicate, e.g., the user&#39;s preferences and habits with respect to each of the market segmentation variables. Alternatively, the data indices can be compared with the target profiles to select the best matching content. 
     In block  218 , the photographic likeness of the user&#39;s ownership item is altered to incorporate the selected content. In block  221 , the user is presented with the altered photographic likeness of the user&#39;s ownership item. Using this process, the user is given a preview of how the selected content looks when applied to the photographic likeness of the user&#39;s ownership item (refer to  FIG. 14  for an example of altering the photographic likeness of the user&#39;s ownership item to apply or incorporate the selected content). 
       FIG. 10  illustrates a preferred system for targeting to the user marketing content relevant to the user&#39;s ownership item. The components (e.g., program instructions) are, e.g., stored in the program memory  14  and executed on the processor  12 . The data storage  16  includes the user profile  50  and a target profile  251 . The user profile  50  includes data elements such as, e.g., the initial survey responses  52 , the context-specific survey responses  60 , the random survey responses  62 , the browsing habits  54 , the purchasing patterns  56 , and the photographic likeness (e.g., the photographic likeness of the user and/or the photographic likeness of the user&#39;s ownership item). The target profile  251  is associated with a content and it includes demographics and/or psychographics information specifying the targeted audience. This information is provided by, e.g., an advertiser, promoter or other entity. A likeness-processing component  253  process the photographic likeness of the user&#39;s ownership item; e.g., the likeness-processing component  253  identifies characteristics of the user&#39;s ownership item. A profile processing component  265  can be used to, e.g., convert the photographic likeness of the user&#39;s ownership item to a standard image. The profile processing component  265  can also assign metrics and algorithms to the data elements in the user profile  50  and apply these metrics and algorithms to the corresponding market segmentation variables to generate data indices. A comparison component  256  compares the user profile  50  or the data indices with a target profile  251  associated with each content to select content that best matches the user profile  50 . An altering component  259  alters the photographic likeness of the user&#39;s ownership item to incorporate the selected content. A user interface  262  (e.g., a computer monitor) presents to the user the altered photographic likeness of the user&#39;s ownership item. 
     Context-specific survey questions and random survey questions are asked periodically to verify weak data elements or supply missing data elements. These survey questions are less intrusive than a lengthy questionnaire and are preferably used throughout the Web site to gather needed information. A preferred embodiment for the implementation of context-specific and random survey questions is illustrated in  FIG. 11 . First, in Step  90 , the user profiles are analyzed in view of the target demographics and psychographics of the available content to identify data elements that have generally weak confidence factors or are otherwise deficient for use in accurately targeting the available content. In a preferred embodiment, this identification of deficient data elements is based on each element&#39;s statistical reliability. The market researcher is notified of the deficiencies in the data in Step  92 . For each deficient data element, a search is conducted in Step  94  to locate content having an associated market segmentation variable that relates to the deficient data element. In Step  96 , the market researcher is prompted to develop a context-specific survey question that relates to the content, the answer to which supplies the deficient data element. For example, if a user is browsing for a pair of shoes, a question asking for the user&#39;s shoe size (i.e., the deficient data in this example) would appear to the user as a helpful shoe finding aid, while providing the deficient data about the user. Such web-content refinement inquiries may be used to query for needed information in a relatively non-intrusive manner and will often yield a more accurate user response than other data collection methods. In a preferred embodiment, the context-specific survey question is presented to the user in a new browser window when the associated content is displayed to the user. In Step  98 , the market researcher is prompted to develop a random survey question, the answer to which supplies the deficient data element. Random questions may be presented to the user periodically, even while the user is viewing unrelated content. 
     The number of survey questions, both context-sensitive and random, presented to the user is preferably limited to avoid overburdening the user. In a preferred embodiment, the number of survey questions asked of the user is limited by allowing a predetermined amount of time to pass between each survey question. For example, context-sensitive questions, which are considered less intrusive to the user than random questions, may be skipped until after the passing of a first predetermined interval of time, and random questions, which are considered more intrusive to the user, may be asked after the passing of a second predetermined interval of time, which is longer than the first predetermined interval of time. 
     Through the data collection methods described above, the user profile data  50  may include the user&#39;s personal contact information and demographic information, two or three dimensional images of the user, audio of the user, video of the user, the user&#39;s body measurements, purchasing habits, purchasing history, entertainment preferences, lifestyle habits, political beliefs, affiliations, religious beliefs, opinions about specific marketing, advertising, entertainment or educational materials, opinions about current news and cultural issues, web surfing habits, and other information that describes the user. It will be appreciated that the use of the data collection procedures described herein does not preclude the collection of data through other methods, such as telephone surveys. 
     The collected data in the user profile data  50  is used to target specific content to the user as illustrated in  FIG. 12  (and as discussed above with reference to  FIG. 7 ). In Step  110 , each data item is assigned metrics and algorithms, and the results are used in Step  112  to create a data index identifying the user&#39;s preferences, habits, etc., with respect to each particular target demographic or psychographic type being used by the content providers. When selecting content to display to the user, the Web server will automatically select the content with target demographics and psychographics that best matches the user&#39;s data index. In addition, on certain Web pages, content that best matches the user&#39;s data index is displayed more prominently to the user than other content displayed on the Web page. For example, an advertisement may be prominently displayed to certain targeted users on the top of a Web page and placed on the bottom of the screen for other users. Further, Web links displayed on the Web page may be arranged in an order that best illustrates the user&#39;s preferences for the links. 
     In the preferred embodiment, the collected and analyzed data, including the psychographic information and the user&#39;s photographic likeness, are also used to create personalized advertisements, marketing materials, entertainment, or educational materials for an individual user. The customer may be identified by reading a client identifier on the customer&#39;s machine, in the form of a cookie, a machine authentication code and IP address, a username and login, or any other method as known in the art. An example of a targeted promotion is illustrated in  FIG. 13 . A Web page  120  includes an article  122  describing the latest trends in eyeglasses, and the photographic likeness of the user  124 . Using user profile information, a pair of eyeglasses is selected from the article that best match the user&#39;s skin tone, face shape and purchasing habits. The eyeglasses  126  are incorporated into the image allowing the user to see how the eyeglasses would look on the user&#39;s face. The eyeglasses are placed on the user&#39;s face in accordance with the location of the user&#39;s eyes, nose and ears, identified when the photographic likeness was first processed. The user may also be given the option of viewing other eyeglasses on the image. 
     In another contemplated embodiment, the user&#39;s photographic likeness is used to present cosmetic recommendations to the user. A beauty expert can provide the logic which the software uses to automatically apply makeup to the user&#39;s photographic likeness. The cosmetics are then applied to the user&#39;s image as part of a personalized advertisement for the cosmetics. The advertisement may include an interface allowing the user to select and view different shades and colors, and make online purchases. In addition, the photographic likeness can be altered to simulate the results of cosmetic procedures; for example, the photographic likeness can be altered to show the removal of age spots, results of a facelift, injection of dermal fillers (e.g., lip size can be increased by injecting Restylane, as shown in  FIG. 23 ). Further, the photographic likeness of the user can be altered to show a decrease or an increase in the user&#39;s weight due to the use of weight loss or weight gain products, can be used to produce holographic images, or can be used to simulate a photographic likeness that talks. Similarly, the photographic likeness can be altered to show a different body type; e.g., a user&#39;s pear shaped body can be altered to demonstrate the user with a hour-glass shaped body resulting from, e.g., following a tailored exercise regimen developed by Bally Total Fitness (e.g. as shown in  FIG. 24 ). Also, the photographic likeness can be altered to simulate hair growth or hair loss which can be used to demonstrate, e.g., the effectiveness of hair restoration products from companies such as, e.g., Bosley Medical. In other embodiments, the user&#39;s likeness may be altered to reflect the approximate look of specific jewelry, accessories (e.g., glasses, hats, and scarves as shown in  FIGS. 15, 16, 18, and 22 ), hairstyles, clothing, and other items. Clothing may be illustrated on a body image that closely matches the user&#39;s body measurements (or clothing sizes) recorded in the user profile. The photographic likeness can be altered to show the effects of aging and deaging. The user&#39;s likeness may also be altered to simulate the user in different locations, anatomical poses, and video or audio situations. For example, an advertisement for a ski vacation may include an action image of the user skiing down a mountain. In addition, an advertisement or promotion may inlay the photographic likeness of the user at a certain place, setting, or background to, e.g., promote a vacation destination, locale, or activity. 
       FIG. 14  illustrates an example of altering the photographic likeness of the user&#39;s ownership item. A Web page  120  includes a photographic likeness of the user&#39;s living room  253 . The photographic likeness of the user&#39;s living room  253  is altered using the user&#39;s preferences stored in the user profile  50  to provide an altered photographic likeness of the user&#39;s living room  256  which incorporates products from advertising clients that adhere to the user&#39;s preferences. The altered photographic likeness of the user&#39;s living room  256  allows the user to preview the living room incorporating products of possible interest to the user and that adhere to the user&#39;s preferences. In the specific example shown in  FIG. 14 , the altered photographic likeness of the user&#39;s living room  256  incorporates burgundy wall paint from Sherwin-Williams (the advertising client) and wall art from Tatouage (another advertising client). In addition, the user may be given the option of incorporating other products (e.g., a different color of wall paint, a new couch, or a new lamp) within the altered photographic likeness of the user&#39;s living room  256 . 
       FIG. 15  illustrates another example of altering the photographic likeness of the user&#39;s ownership item. A Web page  120  includes a photographic likeness of the user  1501 . The photographic likeness of the user  1501  is altered using the user&#39;s preferences stored in the user profile  50  to provide an altered photographic likeness of the user wearing sunglasses  1505 , which incorporates products from advertising clients that adhere to the user&#39;s preferences. The altered photographic likeness of the user  1505  allows the user to preview himself (or herself) incorporating products of possible interest to the user and that adhere to the user&#39;s preferences. In the specific example shown in  FIG. 15 , the altered photographic likeness of the user  1505  incorporates Ray-Ban sunglasses (the advertising client). The altered photographic likeness of user  1505  includes, for example, a beach scene background, suggesting that the user book a beach vacation online using Expedia.com (another advertising client). In this manner, background imagery may be used to enhance targeted marketing capabilities. In addition, the user may be given the option of incorporating other products (e.g., swimwear, sun tan lotion, etc.) within the altered photographic likeness of the user  1505 . 
     In some embodiments, the photographic likeness of the user is further altered using techniques described in parent U.S. patent application Ser. No. 12/714,518 to animate the final image of the selected content incorporated into the user&#39;s photographic likeness. In some embodiments of altering the photographic likeness of the user, one or more objects in the final image that includes the photographic likeness of the user, including one or more selected content and background, are animated with movement. As illustrated with reference to  FIG. 15  according to some embodiments, objects in Web page  120  are animated. For example, the beach scene background, supplied by the advertising client as a still image, is animated to show movement, for example, simulated movement of trees caused by wind. Other objects can also be animated. For example, the shirt on the photographic likeness of the user, originally uploaded as a still image, is animated to simulate movement caused by wind. In another example, the photographic likeness of the user is animated with body movement, and selected content that are applied are animated to move in coordination with the body movement. Body movements includes, for example, movement of the limbs, head, one or more parts of the face to show expression, torso, or legs. In other examples, lip movement includes a kissing movement, or a smile accompanied by corresponding eye crinkling and other facial animation. 
     In some embodiments, the facial expressions are associated with the target profile of the selected content. For example, the photographic likeness of a user is altered to move the lips into a smile, and adjusting the smile to become more wide when a product is applied. In another example, the photographic likeness of the user&#39;s ownership item, a dog, is animated to show wagging movement in a tail when a dog bed is applied to the photographic likeness to show a dog lying in the dog bed. 
       FIG. 16  illustrates another example of altering the photographic likeness of the user&#39;s ownership item. A Web page  120  includes a photographic likeness of the user  1601 . The photographic likeness of the user  1601  is altered using the user&#39;s preferences stored in the user profile  50  to provide an altered photographic likeness of the user with highlights in her hair  1605 , which incorporates products from advertising clients that adhere to the user&#39;s preferences. The altered photographic likeness of the user  1605  allows the user to preview herself incorporating products of possible interest to the user and that adhere to the user&#39;s preferences. In the specific example shown in  FIG. 16 , the altered photographic likeness of the user  1605  incorporates Herbal Essences hair products (the advertising client) and recommends purchasing the product at Macy&#39;s (another advertising client). In addition, the user may be given the option of incorporating other products (e.g., hats, sweaters, necklaces, accessories, etc.) within the altered photographic likeness of the user  1605 . 
       FIG. 17  illustrates another example of altering the photographic likeness of the user&#39;s ownership item. A Web page  120  includes a photographic likeness of the user  1701 . The photographic likeness of the user  1701  is altered using the user&#39;s preferences stored in the user profile  50  to provide an altered photographic likeness of the user in a BMW vehicle  1705 , which incorporates products from advertising clients that adhere to the user&#39;s preferences. The altered photographic likeness of the user  1705  allows the user to preview himself incorporating products of possible interest to the user and that adhere to the user&#39;s preferences. In the specific example shown in  FIG. 17 , the altered photographic likeness of the user  1705  incorporates BMW vehicles (the advertising client) and recommends purchasing the vehicle at a BMW dealer in the user&#39;s area. 
       FIG. 18  illustrates yet another example of altering the photographic likeness of the user&#39;s ownership item. A Web page  120  includes a photographic likeness of the user  1801 . The photographic likeness of the user  1801  is altered using the user&#39;s preferences stored in the user profile  50  to provide an altered photographic likeness of the user with new hairstyles  1805 ,  1810  and new clothes  1815 ,  1820 , which incorporates products from advertising clients that adhere to the user&#39;s preferences. The altered photographic likeness of the user  1805 ,  1810 ,  1815 , and  1820  allows the user to preview herself incorporating products of possible interest to the user and that adhere to the user&#39;s preferences. In the specific example shown in  FIG. 18 , the altered photographic likeness of the user  1805 ,  1810 ,  1815 , and  1820  incorporates Easy Piece clothing, (the advertising client) Sami hairstyles, (another advertising client) and Lauren Hutton cosmetics (yet another advertising client). 
       FIG. 19  illustrates yet another example of altering the photographic likeness of the user&#39;s ownership item. A Web page  120  includes an illustrated image or cartoon likeness of the user  1901 . The illustrated image likeness of the user is altered using the user&#39;s preferences stored in the user profile  50  to provide images of the user in new fashion ensembles of the user  1905 ,  1910 , and  1920 , which incorporates products from advertising clients that adhere to the user&#39;s preferences. The altered illustrated likeness of the user  1905 ,  1910 , and  1920  allow the user to preview herself incorporating products of possible interest to the user and that adhere to the user&#39;s preferences. In the specific example shown in  FIG. 19 , the altered illustrated likeness of the user  1905 ,  1910 , and  1920  incorporates fall fashion looks for daytime, nighttime, and high glamour ensembles from Macy&#39;s (the advertising client). In addition, the user may be given the option of incorporating other products (e.g., hairstyles, belts, brooches, necklaces, accessories, etc.) within the altered illustrated image likeness of the user  1905 ,  1910 , and  1920 . 
       FIG. 20  illustrates another example of altering the photographic likeness of the user&#39;s ownership item. A Web page  120  includes a photographic likeness of the user&#39;s pet  2001 . The photographic likeness of the user&#39;s pet  2001  is altered using the user&#39;s preferences stored in the user profile  50  to provide an altered photographic likeness of the user&#39;s pet with a holiday sweater  2005 , which incorporates products from advertising clients that adhere to the user&#39;s preferences. The altered photographic likeness of the user&#39;s pet  2005  allows the user to preview her (or his) pet incorporating products of possible interest to the user and that adhere to the user&#39;s preferences. In the specific example shown in  FIG. 20 , the altered photographic likeness of the user&#39;s pet  2005  incorporates products from PETCO.com (the advertising client). In addition, the user may be given the option of incorporating other products (e.g., hats, collars, accessories, etc.) within the altered photographic likeness of the user&#39;s pet  2005 . 
       FIG. 21  illustrates yet another example of altering the photographic likeness of the user&#39;s ownership item. A Web page  120  includes a photographic likeness of the user  2100 . The photographic likeness of the user  2100  is altered using the user&#39;s preferences stored in the user profile  50  to provide an altered photographic likeness of the user with a new makeover and jewelry  2105 , which incorporates products from advertising clients that adhere to the user&#39;s preferences. The altered photographic likeness of the user  2105  allows the user to preview herself incorporating products of possible interest to the user and that adhere to the user&#39;s preferences. In the specific example shown in  FIG. 21 , the altered photographic likeness of the user  2105  incorporates a makeover by Sephora (the advertising client) and recommends purchasing jewelry accessories from eLUXURY (another advertising client). In addition, the user may be given the option of incorporating other products (e.g., earrings and other accessories) within the altered photographic likeness of the user  2105 . 
       FIG. 22  illustrates yet another example of altering the photographic likeness of the user&#39;s ownership item. A Web page  120  includes a photographic likeness of the user  2201 . The photographic likeness of the user  2201  is altered using the user&#39;s preferences stored in the user profile  50  to provide an altered photographic likeness of the user with different hairstyles  2205  and  2210 , which incorporates products from advertising clients that adhere to the user&#39;s preferences. The altered photographic likenesses of the user  2205  and  2210  allow the user to preview herself incorporating products of possible interest to the user and that adhere to the user&#39;s preferences. In the specific example shown in  FIG. 22 , the altered photographic likenesses of the user  2205  and  2210  incorporate styles from Frankie&#39;s Salon (the advertising client) and recommends hair products from Pro-V Restoratives (another advertising client). In addition, the user may be given the option of incorporating other products within the altered photographic likenesses of the user  2205  and  2210 . 
       FIG. 23  illustrates yet another example of altering the photographic likeness of the user&#39;s ownership item. A Web page  120  includes a photographic likeness of the user  2301 . The photographic likeness of the user  2301  is altered using the user&#39;s preferences stored in the user profile  50  to provide an altered photographic likeness of the user with more fuller lips  2305 , which incorporates products from advertising clients that adhere to the user&#39;s preferences. The altered photographic likeness of the user  2305  allows the user to preview herself incorporating products of possible interest to the user and that adhere to the user&#39;s preferences. In the specific example shown in  FIG. 23 , the altered photographic likeness of the user  2305  incorporates products from Restylane (the advertising client). 
       FIG. 24  illustrates yet another example of altering the photographic likeness of the user&#39;s ownership item. A Web page  120  includes a photographic likeness of the user  2401 . The photographic likeness of the user  2401  is altered using the user&#39;s preferences stored in the user profile  50  to provide an altered photographic likeness of the user significantly thinner  2405 , which incorporates products from advertising clients that adhere to the user&#39;s preferences. The altered photographic likeness of the user  2405  allows the user to preview himself) incorporating products of possible interest to the user and that adhere to the user&#39;s preferences. In the specific example shown in  FIG. 24 , the altered photographic likeness of the user  2405  illustrates the potential results after using products from NutriSystem (the advertising client). 
       FIG. 25  illustrates yet another example of altering the photographic likeness of a user or a user&#39;s ownership item, according to one embodiment. In  FIG. 25 , a web page  120  includes a photographic likeness of the user  2501 . Alternatively, a web page may include an ownership item. The photographic likeness may be stored locally on the network device  30 . The photographic likeness of the user  2501  is altered using a selected color  2503  or colors to alter the color of make-up, or clothing or other ownership items. Upon applying the selected color  2503 , a preview of the altered image of the user  2501  is shown. The color may be selected from a library of colors or from a palette. Alternatively, the user may select any color shown in a computer monitor or device display. In an embodiment, product recommendations matched to the selected color are also presented to the user. 
     In another embodiment, the color application is a web toolbar that is accessible also from a mobile device which allows users to take pictures and select color matches from the world around them. 
       FIG. 26  illustrates a process  2600  for searching for products or services based on the user&#39;s selection of a color from an image or picture according to one embodiment of the invention. At step  2602 , a user search interface program that connects to a search database is accessed by a user. The user search interface program may be a dynamic website, a desktop application, a mobile device (i.e. mobile phone, smart phone, e-book reader or tablet) application, an embedded applications in specialized electronic devices (i.e. digital cameras, digital picture frames, video game systems and TVs), or any other accessible database. 
     The search database may contain the universe of products or services to be searched in a specified domain. It may exist locally alongside the user search interface program or across the network connection on a computer server. 
     At step  2604 , the user search interface program receives a selection of a color from the user that is to be searched across one or more product or service domains (e.g. lipstick, makeup, paint colors). The selection of color is executed in a variety of ways, including but not limited to: receiving a color selection based on an area of color as displayed on a computer monitor or device screen; receiving a color selection based on an area of color from an electronic image; receiving a color selection based on the colors captured by a digital camera and sensor; receiving a color selection by scanning or taking a photo of camera-ready image link (e.g. QR Code); or receiving a color selection by entering the colors value (i.e., RGB hex value, Pantone Number or other standard colors value). 
     According to one embodiment of the invention, to select a color based on an area of color as displayed on a computer monitor or device screen, the user search interface program presents a simulation of a loupe or magnifying glass that magnifies the area under the mouse pointer or user&#39;s finger. This allows the user to precisely target the point of color that is to be used in the selection. The area of color as displayed on a computer monitor or device screen can be from local or remote sources, including colors supplied in third-party applications or videos. 
     In selecting a color, the user may search product results only, without seeing it demonstrated on their image, but just viewing the colors. Alternatively, the user can search for product of a certain color and see it on their own image. 
     At step  2606 , the user search interface program presents to the user controls to modify the color of the selection. These controls function similarly to the various color controls in image editing programs as known to one of skill in the art. 
     At step  2608 , the finalized selection received by the user search interface program is submitted to the search database to determine products or services in the specified domains or optionally generally across the web that precisely match the selected color. Alternatively, the search database can be queried to determine colors that are close to the selected color as determined by color-matching algorithms, or that complement the selected color as determined by color-complementing algorithms. 
     At step  2610 , the search results are returned from the search database to the user search interface program. In one embodiment, they may be displayed as a series of links or images or displayed on the user&#39;s image or likeness as described. 
       FIG. 27  illustrates yet another example of altering the photographic likeness of the user by applying a transformation related to an interactive advertisement presented to the user. A Web page  120  includes a photographic likeness of the user. The photographic likeness of the user is altered using the user&#39;s preferences stored in the user profile  50  to provide an altered photographic likeness  2701  of the user with products  2703 ,  2705 ,  2707  being advertised on the interactive advertisement applied to the photographic likeness of the user  2701 . In some embodiments, the photographic likeness of the user is altered with products including but not limited to products associated with the advertisement, including products visible or not visible in the advertisement. The altered photographic likeness  2701  of the user allows the user to preview himself incorporating products of possible interest to the user, and products that adhere to the user&#39;s preferences. In the example shown in  FIG. 27 , the altered photographic likeness  2701  of the user illustrates an altered hairstyle, altered sunglasses, altered apparel, based on selections made from interaction with an advertisement. In some embodiments, the transformation is applied to the photographic likeness of the user using products advertised on the advertisement without receiving selections or input from the user. For example, as an advertisement is presented, the products are applied to the photographic likeness without further input from the user to instruct the system. 
     In some embodiments of altering the photographic likeness of the user by applying a transformation related to an interactive advertisement presented to the user, one or more objects in the graphic featuring the altered photographic likeness  2701  of the user, including one or more of products  2703 ,  2705 ,  2707 , are animated with movement. For example, all objects in the graphic featuring the altered photographic likeness  2701 , including necktie  2707 , hairstyle  2703 , and other clothing and background shown in the photographic likeness of the user, are animated with movement as if blown by the wind, using techniques described in parent U.S. patent application Ser. No. 12/714,518. In another example, the photographic likeness of the user is animated with body movement, and one or more of products  2703 ,  2705 ,  2707  are animated to move in coordination with the body movement. Body movements includes, for example, movement of the limbs, head, one or more parts of the face to show expression, torso, or legs. In other examples, lip movement includes a kissing movement, or a smile accompanied by corresponding eye crinkling and other facial animation. 
     In another example, a beach vacation is the subject of the advertisement. In this example, the photographic likeness of the user is altered by integrating a background of a beach scene with the photographic likeness, with the photographic likeness appearing at a beach. In this example, the source image of the advertisement supplied from the advertiser is a still image, but the waves are animated as rolling behind the photographic likeness of the user in the background. In some embodiments, the photographic likeness is of many people or ownership items. 
     According to one embodiment, the example illustrated in  FIG. 27  can also be applied to alter the photographic likeness of a user&#39;s ownership item. According to further embodiments, the example illustrated in  FIG. 27  can be applied to alter the photographic likeness captured as frames by a video input device in real time. 
       FIG. 28  illustrates a process  2800  for interacting with an advertisement to alter a photographic likeness of a user or of a user&#39;s ownership item. In one embodiment of the invention, advertising presented to the user for interacting as described in process  2800  includes advertising on websites accessed through a desktop computer or computer kiosk, desktop applications or games, websites accessed through mobile devices (i.e. mobile phones, smart phones, e-book readers and tablets), applications or games on mobile devices (i.e. mobile phones, smart phones, e-book readers and tablets), embedded applications in specialized electronic devices (i.e. digital cameras, digital picture frames, video game systems and TVs), emails or other text based communication methods (i.e. SMS and IM). 
     The advertisements presented to the user can be in the form of graphical banners on a webpage or in an application, text advertisements on a webpage or in an application, links in editorial stories or articles (i.e. blog entry or online news article), email, SMS text message or IM links, or camera-ready image links (e.g. SnapTags). 
     At step  2802 , a selection or click on an advertisement is received as input by a targeted marketing application. The selection may be of a product being advertised (e.g., a hat, a shirt, or a pair of sunglasses), a service being advertised (e.g., a haircut, an artificial tan, a weight-loss program), or a background in the advertisement (e.g., beach scene, a red carpet premiere). 
     At step  2804 , the selection is applied to a photographic likeness of a user, and at step  2806 , the transformation is displayed to the user. In one embodiment, when the process  2800  is invoked within a targeted marketing application with a user profile previously loaded, the selection is applied to the photographic likeness of a user that is loaded by the targeted marketing application, within the application&#39;s interface. In one embodiment, when the process  2800  is invoked within a webpage as a toolbar-type application, the selection is applied to a photographic likeness of a user that is within the original advertisement banner space, either appearing or replacing the advertisement, or in a modal window that appears over the underlying webpage or application, or in a new window. 
     In one embodiment, the user has a user profile in the web server, but is not invoking process  2800  through a dedicated application interface. In this embodiment, the web server can identify the user by storing a cookie or a token on the user&#39;s computer or device, by accessing a user&#39;s current active and authenticated browser session at another website (e.g., authenticated Facebook session), or by requesting the user&#39;s input of credentials (e.g., user name and password). 
     In another embodiment, the user does not have any user profile in the web server, and is not invoking process  2800  through a dedicated application interface. In this embodiment, the user may register and/or upload a photo of their image, or the application may present to the user stock photographs of photographic likeness of other people to use. 
     At step  2808 , the user is presented with an option to make purchases based on the advertisement with which the user interacted. 
     According to one embodiment of the invention, a user may alter the photographic likeness of the user by applying a transformation based on search results obtained by the user in conducting text searches (e.g., regular Google search), visual searches (i.e., the user submits a photo to find that particular or similar items), color searches (i.e., searching for a specific color chosen with a color wheel or other color picker), or product recommendations based on search history (e.g., “Customers who purchased this product also purchased . . . ”)]. 
       FIG. 29  illustrates a process  2900  for applying a transformation based on search results obtained by the user. In one embodiment, the search results are obtained using searches generated from websites accessed through a desktop computer or computer kiosk, desktop applications, websites accessed through mobile devices (i.e. mobile phones, smart phones, e-book readers and tablets), applications on mobile devices (i.e. mobile phones, smart phones, e-book readers and tablets), embedded applications in specialized electronic devices (i.e. digital cameras, digital picture frames, video game systems and TVs), and text communications based searches (i.e. SMS and IM). 
     At step  2902 , a search is submitted to a search application for products and services by a user while a targeted marketing application is invoked as a foreground or as a background application. At step  2904 , the targeted marketing application detects a set of search results that are returned by the search application. At step  2906 , a search result is applied to alter or transform the user&#39;s photographic likeness of the user that is currently active in the user&#39;s user profile. Alternatively, the search result is applied to alter or transform the user&#39;s photographic likeness of the user&#39;s ownership items. Examples of search results that can be applied include, but are not limited to, a product (e.g., a hat, a shirt, or a pair of sunglasses), a service (e.g., a haircut, an artificial tan, a weight-loss program), or a background (e.g., beach scene, a red carpet premiere). 
     In one embodiment, the first search result as determined by the search application is applied to transfer the photographic likeness of the user or of the user&#39;s ownership item. Alternatively, a best search result as determined by the search application is applied to transfer the photographic likeness of the user or of the user&#39;s ownership item. 
     In one embodiment, when the process  2900  is invoked within a targeted marketing application with a user profile previously loaded, the selection is applied to the photographic likeness of a user that is loaded by the targeted marketing application, within the application&#39;s interface. In one embodiment, for example when the process  2900  is invoked within a webpage as a toolbar-type application or other background application, the search result is applied to transform the photographic likeness of a user in lieu of the search result. Alternatively, many instances of a photographic likeness of a user are transformed using each of the search results. In still another embodiment, the transformed image is presented alongside other search results that are not applied to any image. The transformed image may also be presented in a modal window that appears over the underlying webpage or application, or in a new window. 
     In one embodiment, the user has a user profile in the web server, but is not invoking process  2900  through a dedicated application interface. In this embodiment, the web server can identify the user by storing a cookie or a token on the user&#39;s computer or device, by accessing a user&#39;s current active and authenticated browser session at another website (e.g., authenticated Facebook session), or by requesting the user&#39;s input of credentials (e.g., user name and password). 
     In another embodiment, the user does not have any user profile in the web server, and is not invoking process  2900  through a dedicated application interface. In this embodiment, the user may register and/or upload a photo of their image, or the application may present to the user stock photographs of photographic likeness of other people to use. 
     In one embodiment of the invention, the embodiments described above may be integrated with an interface that functions as a virtual mall or virtual retail commercial space, as illustrated with reference to  FIG. 30 . In one embodiment, in the interface  3002 , a rendering of a virtual retail space can be navigated by the user in three dimensions from a first-person point-of-view or from a third-person point-of-view. In one embodiment, the third-person point-of-view includes a simulation of a camera&#39;s view of following a likeness of the user that has been uploaded to the user&#39;s profile as the likeness of the user moves through the virtual rendered space. 
     The virtual retail interface  3002  may consist of one or more stores  3004 . There may be a fixed set of stores or the stores and layout may be personalized to the user. One embodiment includes a fixed mall within a standalone application that the user may explore alone. Alternatively, the virtual retail interface may include a public online mall where all users visit a fixed set of stores and may interact with friends or strangers, a private online mall instance where only the user and invited friends are allowed to log on and shop together, a customized public or private mall designed by the user populated by stores that the user selected (e.g., parents could choose what stores their children are allowed to visit), or a computer-generated public or private mall populated with stores chosen for the user based on the user&#39;s history and preferences. 
     The virtual retail interface may be interacted with by the user in various aspects. In one embodiment, the user may select products  3006 , services, or backgrounds from the interface as the user navigates through the three-dimensional rendering of a virtual retail space. Using the techniques described in the embodiments above, the selections may be used to transform a photographic likeness of the user  3008  or a user&#39;s ownership items that have been loaded into the user&#39;s profile. 
     In one embodiment, based on the user&#39;s history and preferences, the virtual retail interface will modify the interface to present product promotions and recommendations. In one embodiment, the interface may present items within the interface that are worn or presented with the user&#39;s own image or likeness (e.g., virtual billboards, kiosks, mannequins featuring the user&#39;s image wearing different items and looks). In another embodiment, the interface features a virtual mirror where a user may select different products to modify or transform the user&#39;s likeness as seen in a virtual mirror object depicted in the interface. 
     In one embodiment of the interface, upon receiving a selection input by a user based on a product, service, or background with which the user interacts, a purchase interface is presented to the user. 
     In one embodiment, the virtual mall interface is accessible via a network by multiple users. Each user interacts with the same virtual space, and may encounter and interact with each other within the virtual space. Possible interactive scenarios include the following: one or more other users can travel through the mall with the user, and chat using text or voice; one or more other users can also see what selections the user has chosen to transform the photographic likeness of the user or of the user&#39;s ownership item (i.e., what the user “tries on”), and offer feedback and opinions; one or more other users can select and instantly try-on what the user is wearing to see how they look with those products; the user can send pictures of try-ons to other users via email or MMS. 
     Having described embodiments of the Targeted Online Marketing System and Method, it should be apparent to those skilled in the art that certain advantages have been achieved. It should also be appreciated that various modifications, adaptations, and alternative embodiments thereof may be made within the scope and spirit of the present invention. The scope of the present invention is defined by the following claims.