Abstract:
A system manages display and retrieval of image content on a network by identifying the image and linking the image to related information, such as licensing information or usage rights. The system manages the display of image content stored within a network by associating thumbnail images that link to versions of the image content stored on a network. One example is a thumbnail that acts as a bookmark linking to image signal content stored on a distributed network of computers, such as links to web pages accessible on the internet. Corresponding methods are also provided.

Description:
RELATED APPLICATION 
     This application is a continuation of application Ser. No. 11/050,407, filed Feb. 2, 2005 (U.S. Pat. No. 7,685,426), which is a continuation in part of application Ser. No. 10/112,884, filed Mar. 29, 2002 (published as US 2002-0196272 A1), which is a continuation of application Ser. No. 09/165,142, filed Oct. 1, 1998 (U.S. Pat. No. 6,421,070). This patent application is also related to: application Ser. No. 08/746,613, filed Nov. 12, 1996 (U.S. Pat. No. 6,122,403); application Ser. No. 09/972,792, filed Oct. 5, 2001 (published as US 2005-0058313 A1); application Ser. No. 09/612,177, filed Jul. 6, 2000 (U.S. Pat. No. 6,681,029); application Ser. No. 08/746,613, filed Nov. 12, 1996 (U.S. Pat. No. 6,122,403); application Ser. No. 08/649,419, filed May 16, 1996 (U.S. Pat. No. 5,862,260); and PCT/US96/06618, filed May 7, 1996 (published as WO 96/36163). The above patents and patent applications are hereby incorporated by reference. 
    
    
     FIELD OF THE INVENTION 
     The invention relates to managing, identifying, indexing, and linking to content, and particularly image signals, on networks, such as web pages on the Internet. 
     BACKGROUND AND SUMMARY OF THE INVENTION 
     There are numerous commercially available programs called “browsers” that facilitate accessing and displaying data. The two leading commercially available browsers are the “Netscape Communicator” which is distributed by Netscape Corporation of Mountain View, Calif. and the “Internet Explorer” browser that is distributed by Microsoft corporation of Redmond, Wash. 
     Browsers allow one to utilize the internet to access web pages located at remote sites. A browser displays web pages in a window on a display device. The web pages that are displayed can contain both text and images. 
     Technology called stegangraphy had been developed which allows one to store digital data in an image. Such data is frequently termed a “digital watermark”. The digital data is not visible when an image containing such data is displayed with a conventional browser; however, the image can be passed through a special program which can detect and read the hidden data. Systems for storing digital data in images and for then reading such data from the images are for example shown in U.S. Pat. No. 5,636,292 and in U.S. Pat. No. 5,748,783. Such technology is also discussed in the “Communications of the ACM” published July 1998 Vol. 41. No. 7 pages 31 to 77. 
     The following disclosure describes programs that work with a browser to provide functions that are not performed by prior programs. A typical web page displayed by a browser contains several images. With a conventional browser, a user can not visually determine if any of the images displayed on a web page contain a watermark, and cannot create and use image bookmarks. 
     One method described in this disclosure is a method of managing content, and in particular, managing content on the Internet. The method retrieves a web page that includes an image and detects whether the image included within the web page is embedded with a digital watermark. It generates an indicia associated with an image included in the web page that is embedded with a digital watermark. The indicia indicate to the user which images include watermarks. The watermarks may be used to convey links to related web pages or specific information about the images, such as usage rights and licensing information. Variations of this method create image bookmarks to web pages including images using thumbnails of those images. 
     Another aspect of the disclosure is a system for managing content. The system comprises a first program for retrieving web pages including images. It also includes a second program for extracting an image from a web page, creating a thumbnail of the image, and forming an image bookmark linking the thumbnail to the web page that the image has been extracted from. The thumbnails are used to create a visual index to corresponding web pages from which the images originated on the Internet, for example. 
     Another aspect of the disclosure is a method of visual indexing of content on a network, such as the Internet. The method retrieves a web page, extracts an image included on the web page, generates a thumbnail of the image, and creates a link between the thumbnail and a location of the web page from which the image has been extracted. 
     One embodiment is implemented as an adjunct to a convention browser which displays web pages including images. In this embodiment, visual indicia is placed on images that include a digital watermark so that a user can know that the image contains hidden watermark data. By clicking on the indicia which is placed on the image, the user will be linked to the web page identified by the watermark data hidden in the image. In this embodiment, such a link can be established without the web page designer having to include a tag in the web page which displays the original image. This embodiment also opens a separate window depicting a thumbnail of each image in a web page. If a user right clicks on one of the thumbnails in this window the image will be added to a list of images in a special image bookmark file. When a user opens the bookmark web page, thumbnails of all the stored images in the bookmark file are displayed. A user can recall the web page which originally contained the image by clicking on the thumbnail. 
     Another aspect of the disclosure is a system comprising: a memory; and a processor in communication with the memory and programmed to retrieve an image signal. The processor is programmed to compute identifying information from the image signal, and to associate the identifying information with a link to additional information related to the image signal. The processor is also programmed to create a thumbnail of the image signal, and programmed to form an image bookmark linking the thumbnail to a network location where the image signal is stored. 
     Yet another aspect of the disclosure is a method comprising: retrieving an image signal; using a programmed processor, computing identifying information from the image signal; associating the identifying information with a link to additional information related to the image signal; creating a thumbnail of the image signal; forming an image bookmark linking the thumbnail to a network location where the image signal is stored. 
    
    
     
       BRIEF DESCRIPTION OF THE FIGURES 
         FIG. 1  is a block diagram of a browser. 
         FIG. 2  is a block diagram of an embodiment. 
         FIG. 3  is flow diagram of the operation of the preferred embodiment. 
         FIG. 4  is a diagram of a display screen of the preferred embodiment. 
         FIG. 5  is a diagram of a display screen showing bookmarks. 
         FIG. 6  is a flow diagram of the operation of the bookmark program. 
     
    
    
     DETAILED DESCRIPTION 
     An embodiment is implemented utilizing what is known in the art as “helper application” for the Internet Explorer 4.0 browser. The Internet Explorer 4.0 browser is commercially distributed by Microsoft Corporation.  FIG. 1  is a block diagram of the commercially available Internet Explorer 4.0 browser  10 . Browser  10  provides a mechanism for receiving and displaying data (called Web Pages) received from the World Wide Web (which is often referred to as W W W). 
     The embodiment described herein is designed to operate based on watermarks which have a particular format designed by Digimarc Corporation. Many of the commercially available programs which can insert watermarks in images and which can detect watermarks in images utilize this watermark format. For example, the Digimarc format is used by the following commercially available programs: “Adobe PhotoShop” Versions 4.0 and 5.0 and “Adobe ImageReady” Version 1.0 which are marketed by Adobe Corporation, “CorelDRAW” Versions 7 and 8, and “Corel PHOTO-PAINT” Versions 7 and 8 which are marketed by Corel Corporation, and Micrografx Webtricity” Versions 1 and 2, “Micrografx Graphics Suite 2”, and “Micrografx Picture Publisher” Versions 7 and 8 which are marketed by Micrografx Corporation. 
     The base program in the Internet Explorer 4.0 browser, that is, the program which begins the operation of the browser  10  is IEXPLORE.EXE  11  which is shown in  FIG. 1 . Program  11  calls the web browser control dynamic link library SHDOCVW.DLL  12 . As stated in the documentation of the Internet Explorer provided by Microsoft SHDOCVW.DLL  12  “supplies the functionality associated with navigation, in-place linking, favorites and PICS support.” SHDOCVW.DLL  12  in turn hosts or calls the MSHTML.DLL  13  dynamic link library. MSHTML.DLL “performs the HTML parsing and rendering” and also “exposes the HTML document through the Dynamic HTML Object Model”  14 . The HTML Object Model  14  hosts the Active X Control  14 A, the Active X Engine  14 B, the JAVA VM  14 C and the Plug In Applet  14 D. The various components in browser  10  store and retrieve information from URL Cache  15 . The operation and function of the various components of the Internet Explorer browser are described in the publicly available literature (and on the web site) provided by Microsoft Corporation. 
     An embodiment adds a browser helper object  21  and two other programs  22  and  23  as shown in  FIG. 2 . Program  22  is a conventional program designed to detect a watermark in an image. One example of such a program is shown in U.S. Pat. No. 5,636,292. Another program for detecting watermarks is shown in U.S. Pat. No. 5,689,587. The browser helper object  21  interfaces with the dynamic link library MSHTML.DLL  13  and with the URL cache  15 . 
       FIG. 4  illustrates an example of a web page being displayed in a window  40  on display screen  41  by browser  10 . The example shown in  FIG. 4  has four images designated image  1 , image  2 , image  3  and image  4 . It should understood that the number of images and the placement of the images varies in each web page displayed and it is determined by the person who creates a web page. Furthermore, text may be interspersed with the images. The example shown in  FIG. 4  is a simple example of a web page which is herein used to illustrate the operation of an embodiment. 
     The embodiment detects which images on a web page contain a watermark. The images which contain watermarks are flagged or noted by means of an indicia which is added to the lower right hand corner of any images that contain watermarks. In the example shown in  FIG. 4 , image  3  contains a watermark and thus indicia  46  appears on the lower right hand corner of the image. Indicia  46  could for example be a logo which identifies a particular company or it could be any other easily identified mark or symbol. It could be as simple as the letters WM or it could be a small multicolored image. The indicia which is displayed is stored in GIF file (Graphic Interchange Format file) and referenced by HTML code (HyperText Markup Language code) which causes the indicia to be displayed. 
     The data in the watermarks (which have the previously defined format) includes a particular HTML address. In the embodiment, if a user clicks on the indicia  46 , a link is created and executed to a particular web page on a particular server herein identified as “www.digimarc.com/cgi-bin”. 
     The program  20  also opens a separate window  42  and it places a thumbnail (i.e. a reduced version) of each image in window  42 . In the example shown in  FIG. 4 , thumbnails  42 A,  42 B,  42 C and  42 D are small versions of images  1  to  4  respectfully. 
     Program  20  also creates an image or “button”  45  which contains the symbol BM. If a user right clicks on one of the images in window  42 , that image is saved as a bookmark. If at a later time a user clicks on the BM image  45 , the system displays a list of the previously saved images  53   a  to  53   h  as shown in  FIG. 5 . When a user clicks on one of the displayed images  53   a  to  53   h , a link is executed to the page from which the image originated, and thus that page is again displayed by the browser  10 . 
       FIG. 3  is a block flow diagram of the operation of the browser helper object  21  and program  22 . Block  31  indicates that initially the browser  10  receives data and it renders images in window  40  on the screen  41  as is normal for the operation of the browser  10 . Block  32  indicates that when the download operation is complete, MSHTML.DLL  13  sends a “Download complete event” and a “Document Object” to Browser helper Object  21 . The Document Object includes the URL addresses of each of the images in the page that is displayed. The characteristics of a Download Complete Event and a Document Object is explained in the documentation provided by Microsoft Corporation. Block  34  indicates that Browser Helper  21  sends a request to MSHTML for the address in cache  15  of one of the URL addresses which it previously received. The documentation supplied by Microsoft corporation explains how the above operations are performed. 
     Block  35  indicates that when browser helper  21  receives a Download Compete Event from MSHTML.DLL  13 , the browser helper  21  queries the “Document Object”. The images which are in the page being displayed are available to the browser helper  21  in the current “Document”. The browser helper  21  retrieves the image data from the URL cache  15  and processes it as follows: The image is passed through watermark detector program  22  to determine if the image contains a watermark and bookmark program  23  places a thumbnail of the image in window  32 . 
     As indicated by block  38 , if no watermark is detected (and if this is not the last image which appears in the window being displayed) the program flow returns to block  34  and the process repeats for another image. If the image being processed is the last image in a window the process stops and does not begin again until browser helper  21  receives another “download Compete Event” signal. 
     If a watermark is detected by watermark detector  22 , the process proceeds to block  39 . As indicated by block  39 , in this event helper Program  21  calculates the position of the lower right hand corner of the image and “inserts” a HREF and an IMG tag to the current document object of MSHTML.DLL. In response to the HREF and IMG tag, MSHTML.DLL will display an indicia such as indicia  46  in the lower right hand corner of the image with the watermark. The browser helper can calculate the lower right hand corner of the image where the indicia  46  is to be inserted from the location data of the image. The location where the image is to be inserted is given in the HREF command. The following is an example of and HREF and IMG tags: 
     
       
         
               
             
           
               
                   
               
             
             
               
                 &lt;a href=”http://www.digimarc.com/cgi-bin/c1.p1?4+404407+0.0.+1.” 
               
               
                 &lt;IMG SRC=’ind46.gif’ STYLE= 
               
               
                 ”position:absolute;left:125;top:200;filter;alpha(opacity)”&gt; 
               
               
                 &lt;/a&gt; 
               
               
                   
               
             
          
         
       
         
         
           
             where: ind46.gif is a GIF image of the indicia  46 . 
           
         
       
    
     The general format of such HREF and IMG tags is conventional. Likewise the technique for “inserting” a HREF and an IMG tag to the current document object of MSHTML.DLL is known. 
     When watermark detector  22  determines that a particular image contains a watermark, the browser helper  21  inserts tags such as the above to the MSHTML.DLL  13  which then superimposes indicia  46  over the image being displayed by the browser  10 . 
     An Active X browser control program publicly available from Microsoft Corporation is used to display the thumbnails in window  42  as shown in  FIG. 4 . The Active X browser control program is also used to display the image bookmarks as shown in  FIG. 5 . A specific example of image HTML used to display thumbnails in window  42  using an Active X browser control is given below. 
     
       
         
               
               
             
           
               
                   
               
             
             
               
                 &lt;table width= 72&gt; 
                   
               
               
                 &lt;tr&gt;&lt;a href=‘http://safari.altavista.digital.com/cgi-bin/VP?START=1’ 
                   
               
               
                 title=‘http://safari.altavista.digital.com/cgi-bin/VP?START=1’&gt;&lt;font 
                   
               
               
                 size=1 color=‘blue’ face=‘Verdana,Arial,Helvetica’&gt; &lt;P 
                   
               
               
                 onmouseover=“this.style.color = ‘red’”; onmouseout= 
                   
               
               
                 “this.style.color = ‘blue’”;&gt;Corbis Picture Experience - AltaVista - 
                   
               
               
                 BETA TEST&lt;P&gt; 
                   
               
               
                 &lt;/font&gt;&lt;/a&gt;&lt;/tr&gt; 
                   
               
               
                 &lt;/table&gt; 
                   
               
               
                 &lt;table cellspacing=‘1’ cellpadding=‘1’, border=‘0’ width=‘72’&gt; 
                   
               
               
                 &lt;tr&gt; 
                   
               
               
                   &lt;td rowspan=‘2’ &gt;&lt;a 
                   
               
               
                 href=‘http://safari.altavista.digital.com/cgi-bin/VP?START=1‘&gt;&lt;img 
                   
               
               
                 src=“http://safari.altavista.digital.com/Assets/coravcpe.gif” 
                   
               
               
                 border=‘0’ 
                   
               
               
                 title=‘http://safari.altavista.digital.com/Assets/coravcpe.gif’ 
                   
               
               
                 border=‘0’ 
                   
               
               
                 height=‘30’ width=‘70’&gt;&lt;/a&gt; 
                   
               
               
                 &lt;/td&gt; 
                 {close oversize bracket}  
               
               
                     &lt;td&gt;&lt;/td&gt; 
                   
               
               
                 &lt;/tr&gt; 
                   
               
               
                 &lt;tr&gt; 
                   
               
               
                     &lt;td&gt;&lt;/td&gt; 
                   
               
               
                 &lt;/tr&gt; 
                   
               
               
                 &lt;tr&gt; 
                   
               
               
                   &lt;td rowspan=‘2’ &gt;&lt;a 
                   
               
               
                 href=‘http://safari.altavista.digital.com/cgi-bin/VP?START=1’&gt;&lt;img 
                   
               
               
                 src=“http://safari.altavista.digital.com/Assets/coravtitle.gif” 
                   
               
               
                 border=‘0’ 
                   
               
               
                 title=‘http://safari.altavista.digital.com/Assets/coravtitle.gif’ 
                   
               
               
                 border=‘0’ 
                   
               
               
                 height=‘50’ width=‘70’&gt;&lt;/a&gt; 
                   
               
               
                 &lt;/td&gt; 
                 {close oversize bracket}  
               
               
                     &lt;td&gt;&lt;/td&gt; 
                   
               
               
                 &lt;/tr&gt; 
                   
               
               
                 &lt;tr&gt; 
                   
               
               
                     &lt;td&gt;&lt;/td&gt; 
                   
               
               
                 &lt;/tr&gt; 
                   
               
               
                 &lt;tr&gt; 
                   
               
               
                   &lt;td rowspan=‘2’ &gt;&lt;a 
                   
               
               
                 href=‘http://safari.altavista.digital.com/cgi-bin/VP?START=1’&gt;&lt;img 
                   
               
               
                 src=“http://safari.altavista.digital.com/Assets/corav123.gif” 
                   
               
               
                 border=‘0’ 
                   
               
               
                 title=‘http://safari.altavista.digital.com/Assets/corav123.gif’ 
                   
               
               
                 border=‘0’ height=‘52’ width=‘37’&gt;&lt;/a&gt; 
                   
               
               
                 &lt;/td&gt; 
                 {close oversize bracket}  
               
               
                     &lt;td&gt;&lt;/td&gt; 
                   
               
               
                 &lt;/tr&gt; 
                   
               
               
                 &lt;tr&gt; 
                   
               
               
                     &lt;td&gt;&lt;/td&gt; 
                   
               
               
                 &lt;/tr&gt; 
                   
               
               
                 &lt;tr&gt; 
                   
               
               
                 &lt;/table&gt; 
               
               
                   
               
             
          
         
       
     
     The above example includes three images. The brackets at the right hand side of the above code indicate the sections of code which display each image. When in use, the number of images equals the number of images on a particular web page which is being displayed. 
     A block diagram of the program used to add images to the list of image bookmarks is shown in  FIG. 6 . With reference to  FIG. 4 , if a user would like to add one of the images  1  to  4  to a list of images that the user has bookmarked, the user would right clicks on the thumbnail of that image which shown in window  42  (block  61 ). As a result of the right click, a drop down window (not specifically shown) will appear asking for the name the user wants to associate with the image (block  62 ). It is noted that the use of drop down windows to add information is conventional and well known. When the drop down window appears, the user enters a name and the image is added to the list of bookmarks with the name entered. 
     Similar HTML code to that given above is used with the Active X Browser control to display bookmarks as shown in  FIG. 5 . The following is an example of HTML code which displays bookmarks as shown in in  FIG. 5 . Such HTML is conventional and many alternative sequences of HTML can be used to generate a similar page of images. 
     
       
         
               
               
             
           
               
                   
               
             
             
               
                 &lt;html&gt; 
                   
               
               
                 &lt;head&gt; 
                   
               
               
                 &lt;title&gt;Digimarc Watermark Explorer Bookmark&lt;/title&gt; 
                   
               
               
                 &lt;body vlink=‘blue’ link=‘blue’&gt; 
                   
               
               
                 &lt;table width= 100 align=‘center’&gt; 
                   
               
               
                 &lt;tr&gt; 
                   
               
               
                 &lt;td&gt;&lt;a href=‘http://www.cnn.com/’ name=‘Bookmark_C’&gt;&lt;font 
                   
               
               
                 size=1 color=‘blue’ face=‘Verdana,Arial,Helvetica’&gt;&lt;U 
                   
               
               
                 onmouseover=“this.style.color= ‘red’”; 
                   
               
               
                 onmouseout=“this.style.color = 
                   
               
               
                 ‘blue’”; &gt;CNN Interactive&lt;/U&gt; 
                   
               
               
                 &lt;/font&gt;&lt;/a&gt;&lt;/td&gt;&lt;/tr&gt; 
                 {close oversize bracket}  
               
               
                 &lt;tr&gt; 
                   
               
               
                 &lt;td width=‘100’ align=‘center’&gt; 
                   
               
               
                 &lt;a href=‘http://www.cnn.com/’&gt;&lt;img 
                   
               
               
                 src=“http://www.cnn.com/images/1998/05/homepage/cnnin.logo.gif” 
                   
               
               
                 alt=‘http://www.cnn.com/’ border=‘0’ height=‘52’ width=‘70’&gt;&lt;/a&gt; 
                   
               
               
                 &lt;/td&gt; 
                   
               
               
                 &lt;/tr&gt; 
                   
               
               
                 &lt;/table&gt; 
                   
               
               
                 &lt;table width= 100 align=‘center’&gt; 
                   
               
               
                 &lt;tr&gt; 
                   
               
               
                 &lt;td&gt;&lt;a href=“ name=‘Bookmark_M’&gt;&lt;font size=1 color=‘blue’ 
                   
               
               
                 face=‘Verdana,Arial,Helvetica’&gt;&lt;U onmouseover= 
                   
               
               
                 “this.style.color = ‘red’”; 
                   
               
               
                 onmouseout=“this.style.color = ‘blue’”; &gt;Microsoft Inyestor&lt;/U&gt; 
                   
               
               
                 &lt;/font&gt;&lt;/a&gt;&lt;/td&gt;&lt;/tr&gt; 
                   
               
               
                 &lt;tr&gt; 
                   
               
               
                 &lt;td width=‘100’ align=‘center’&gt; 
                   
               
               
                 &lt;a href=”&gt;&lt;img 
                   
               
               
                 src=“http://investor.msn.com/common/images/invlogo.gif” alt=“ 
                   
               
               
                 border=‘0’ height=‘48’ width=‘70’&gt;&lt;/a&gt; 
                   
               
               
                 &lt;/td&gt; 
                   
               
               
                 &lt;/tr&gt; 
                   
               
               
                 &lt;/table&gt; 
                   
               
               
                 &lt;table width= 100 align=‘center’&gt; 
                   
               
               
                 &lt;tr&gt; 
                   
               
               
                 &lt;td&gt;&lt;a href=“ name=‘Bookmark_P’&gt;&lt;font size=1 color=‘blue’ 
                   
               
               
                 face=‘Verdana,Arial,Helvetica’&gt;&lt;U onmouseover=“this.style.color = 
                   
               
               
                 ‘red’”; onmouseout=“this.style.color = ‘blue’”; &gt;PC World&lt;/U&gt; 
                   
               
               
                 &lt;/font&gt;&lt;/a&gt;&lt;/td&gt;&lt;/tr&gt; 
                   
               
               
                 &lt;tr&gt; 
                 {close oversize bracket}  
               
               
                 &lt;td width=‘100’ align=‘center’&gt; 
                   
               
               
                 &lt;a href=”&gt;&lt;img 
                   
               
               
                 src=“http://www.idg.net/channels/ie4/english/images/idg_logo.gif” 
                   
               
               
                 alt=“ border=‘0’ height=‘52’ width=‘70’&gt;&lt;/a&gt; 
                   
               
               
                 &lt;/td&gt; 
                   
               
               
                 &lt;/tr&gt; 
                   
               
               
                 &lt;/table&gt; 
                   
               
               
                 &lt;/body&gt; 
                   
               
               
                 &lt;/html&gt; 
               
               
                   
               
             
          
         
       
     
     The brackets to the right of the above HTML show the sections of HTML used to display one bookmark. Naturally it should be understood that the above is merely an example of one particular set of HTML that can be used to display a list of bookmarks. Various other sequences of code can be used to obtain similar functions. HTML code such as that shown above is conventional and widely used. 
     Another feature that can be added to the preferred embodiment is that window  42  can be used to display a visual history of the pages that have been viewed. That is one could include in window  42  a button that would allow one to scroll back through the thumbnails previously displayed in the window. 
     While the invention has been showed with respect to a preferred embodiment thereof, it should be understood that various changes and modifications can be made without departing from the spirit of the invention. The scope of applicant&#39;s invention is defined by the following claims.