Patent Publication Number: US-2003231186-A1

Title: Method and system for electronic display of photographs

Description:
FIELD OF THE INVENTION  
       [0001] The present invention generally relates to a method and system for electronically displaying and viewing digital photographs, and more particularly to a method that permits users to combine, view, manipulate, and place one or more digital photographs into one or more virtual environments or scenarios. In addition, the system can permit digital photograph owners to control, administer, and resell digital photographs within the system while gathering statistical data on what digital photographs are being or have been viewed. The preferred embodiment of the present invention is directed to the particular application of selling related items of apparel.  
       BACKGROUND OF THE INVENTION  
       [0002] There are a number of problems pertaining to the manner in which people learn, use their senses, and in particular, view objects within electronic systems, such as, but not limited to the Internet. These problems affect Internet shopping, online selling, online promoting, and many other uses of electronic systems. In general, these problems are related to an inequality between the ways electronic systems present information, and how humans experience and gather information in the real, physical world. The issues surrounding the electronic world can be broken down into more specific problems, which include a lack of realism, a lack of trust, and a lack of insight.  
       [0003] In the electronic world, there exists a lack of realism and human immersion, when compared to real “brick and mortar” store shopping. There are many things a user can do in a real environment that, until now, had no electronic equivalent. For instance, “web” users can&#39;t mix and match multi-dimensional digital photographs of items, and then view them, still in combination, from multiple viewpoints, nor can they normally get an adequate sense of texture—even though texture, combining items, and viewing from multiple angles, with depth and dimension is an integral part of shopping in a real store. Additionally, most digital systems are either too static and/or restrictive to provide most users with the sense of spontaneity, discovery, and flexibility that can be found in real stores, or too extravagant to provide utility and meaningful information with similar ease.  
       [0004] Unlike the real world, where objects can be experienced directly, using all human senses, user distrust is a major problem in electronic systems. Not only is the electronic realm generally limited to the single sense of sight, but there are often many different messages about the same subject in electronic systems, making some level of confusion and distrust almost inevitable. Additionally, because of the way the electronic systems work, subjects in digital photographs are likely to appear differently in the digital realm than they do in person, a fact that does not serve to build trust.  
       [0005] In a real store, meaningful sales and business data can be gathered in a number of ways. For example, in the physical world, it is easy to determine what establishments draw clients, and what drives the buying decisions of those clients, since staff can make in-person observations. In fact, in a real store, staff members can further deduce what items draw interest even when sales are not made. By passing this information back to suppliers, the entire chain of business, from producer, to distributor, to retailer can be influenced. Unfortunately, until now, the electronic world has only focused on gathering information pertaining to what sites (stores) draw clients, what files (or pages) are loaded in what quantity in a given time period, the personal information voluntarily provided by users, and what products they actually buy. Because very little information pertaining to pre and post sales is ascertained online, and it is difficult to move any of these types of data up an electronic supply chain, digital businesses are at a decision-making disadvantage.  
       [0006] Even when users are ready to further an electronic relationship, as, for example, when purchasing products, they often find that technical difficulties stand in their way. Electronic technical difficulties are a leading reason behind failed Internet sales and business relationships. Therefore, another main issue in the electronic world is presenting detailed, informative digital photographs and information without overcomplicating, limiting, impeding, or destroying the opportunity to continue online relationships.  
       SUMMARY AND OBJECTS OF THE INVENTION  
       [0007] The present invention provides a system that is aimed at increasing the realism of electronic environments by enabling users to display, mix, match, combine, and manipulate digital pictures of many subjects, where this simultaneous display can originate from many disparate sources, all while presenting a consistent interface to gather additional, related information, and even initiate purchase of displayed items for sale. Thereafter, these pictures can be separated, if desired. The pictures in the system provide corrected relational coloration, and the system can provide tools to tune the user&#39;s display of color, in order to permit the viewer to ascertain reasonably accurate relational and/or absolute color of the objects being viewed, in effect creating a trustworthy visualization space for a plurality of clients. Additionally, the system provides its clients with a number of benefits, including the ability to gather statistical data, create pre-set catalogs of items for electronic distribution, restrict or otherwise contra-indicate the use and availability of specific photographs, and assign further detailed information that users can access in conjunction with the photographs.  
       [0008] In support of the present invention, the above method for visualizing digital photographs includes a number of objects. The first object of the invention provides for photographing at least one item in order to provide a compatible digital photograph and associated data set. Various descriptive pieces of information, which may incorporate, but not be limited to scaling data, descriptive text, coloration information, and alignment data, are associated with each digital photograph as part of an associated data set. The system adjusts digital photograph coloration based on a number of criteria, and the photographs and associated data are digitally stored. High quality, detailed, “close-up” digital photographs, which provide higher magnification without visual “pixilation” when being viewed, can be created and subsequently stored in relation to less detailed digital photographs. The system can create, and thereafter maintain, multiple views of each item, where the associated information for each digital photograph specifies data about the particular view.  
       [0009] After creating digital photographs and associated data, another object of the invention stores the digital photographs and corresponding information data set. This system permits both the system owner and the digital photograph client to authorize what actions certain users or groups of users may take when interacting with the system. This authorization may incorporate, but not be limited to, user and/or group authentication. As an example, the actions a certain client may take can include digital photograph viewing, enabling or disabling systems features, account management, digital photograph management, statistics report viewing, the addition, deletion and management of digital photograph related descriptive textual information, and more. The digital photograph storage object of this invention may permit the resale of rights to use digital photographs to other authorized users of the system. This object of the invention is also responsible for gathering digital photograph viewing statistics and interfacing with billing systems and/or computing and presenting billing information. Note that the database can gather and manipulate user-related data, including, but not limited to commentary, and reference lists, including, but not limited to “wish lists” and gift registries.  
       [0010] Once digitally stored, as per the present invention, digital photographs are treated as copyrighted property, where they can only be viewed using the system&#39;s proprietary electronic digital photograph viewer, which embodies the next object of the invention. The viewer is software that can inter-operate with commonly used “web browsers”, examples of which include, but are not limited to Netscape Navigator and Microsoft Internet Explorer. Note that the viewer is not limited to operation with web browsers, and can be made to work with other systems or applications. Along with many other functions, the viewer creates a graphical environment on the user&#39;s system in which digital photographs can be displayed, mixed, matched, combined and manipulated.  
       [0011] The viewer enforces the rules and controls, set out by the system owner and digital photograph client, on users. Digital photographs obtained, or accessed by any means other than use of the system&#39;s viewer will result in a distorted digital photograph or otherwise undecipherable files, thereby preserving the control of the distribution of each digital photograph within the invention&#39;s domain.  
       [0012] Digital photographs compatible with the viewer can be sourced from any server system, as long as the format, properties, and naming conventions established by the invention owner are followed and permission, in all its forms, as set out by the invention owner and/or digital photograph client, is granted. The viewer can enforce rules regarding acceptable source servers and/or systems. The viewer can function independently of any specific server system or web site, meaning specifically that it can maintain “state information” on behalf of a user regardless of moving from server system to server system. This allows digital photographs related to, or sourced from multiple clients, sites, servers, owners, and/or vendors to be viewed, potentially simultaneously and/or in combination, by the user, in the viewer at one time, and in one or more places.  
       [0013] When digital photographs are combined in the viewer, alignment data is used to control the compositing of digital photographs, automatically. The alignment data is pre-stored and associated with individual digital photographs in previous invention objects, not the display space. As an example of the usage of this alignment data, if the x/y human ankle position is pre-specified in digital photograph A as 200/300 and in digital photograph B as 250/350, the viewer automatically adjusts the origin position of the digital photographs in the final display so that the display position for each places the ankle at the same display coordinate, in this case A could have an origin of 50/50 and B an origin of 0/0 to line up the ankle. Note that this is a generic system, which can line up any other item set as it would shoes on feet.  
       [0014] If multiple views of items have been associated with any digital photograph (in previous invention objects), the user and/or the viewer may be able to change between the views of the item, manually and/or automatically. These additional views could potentially be used, in the viewer, in an unlimited number of ways, but a typical use would be for a series of digital photographs taken from equally spaced angles to permit the impression of turning an item, or set of combined items, moving around an item, or set of combined items, or having an item, or set of combined items, move in some way. Note that the system permits groups of combined items to be manipulated, at one time, while maintaining their realistic combination in the composited view. Additionally, the system permits individual items incorporated in a combination to be changed at any time during manipulation, movement, and/or rotation. Since alignment points are specified for all items and in all views, the display of combinations of compatible digital photographs can continue through multiple angles.  
       [0015] The system and/or the viewer may provide a tool which can color calibrate the user&#39;s display either manually or automatically. The processing of digital photos will be quality controlled to optimize color consistency from photo to photo, where that process may include color tuning based on reference color swatches embedded in each photo. Therefore, the system will offer digital photographs that show proper relational color to each other, with the potential to display proper relational color to a swatch or other reference photograph, and with the potential to present optimum coloration given the user&#39;s display.  
       [0016] The viewer can display textual information that was stored with digital photographs in previous invention objects. This function can be enhanced by using digital photograph-related coordinate points that specify what area of a digital photograph is relevant to each description, in order to relate item information to digital photographs using pointers or highlights, in the multiple views. For example, a description stating, “full-face helmet” can be shown with an arrow, highlight, marker, pointer, as an overlay, or by using some other reference relating the text to the helmet digital photograph. This description, and its referential markers would remain, and potentially remain related to the digital photograph, even when the item is manipulated in the viewer. Textual data can also be shown in relation to the display space, and not directly related to the photograph. Examples of this include, but are not limited to “drop down” information, menu driven textual data displays, and textual data located in other areas of the viewer object. The viewer can display user-related data, including, but not limited to, commentary, and reference lists, including, but not limited to “wish lists”, and distribute or aid in the distribution of such data on the user&#39;s behalf, for example emailing a list of suggested birthday gifts to friends and relatives.  
       [0017] The viewer can display highly detailed “close-up” digital photographs in relation to less detailed digital photographs. These digital photographs permit a high quality zoom feature. The system may permit users to specify the amount and quality of detail in the viewer&#39;s display of digital photographs, and, possibly, in the entire viewer object.  
       [0018] Within the viewer, background digital photographs can be varied in order to add dimensional, virtual context to the virtual environment, and to aid in the visualization of items. Background digital photographs can potentially come from any authorized source, including the user, with the understanding that color accuracy of outside-source photographs cannot be guaranteed. The background digital photograph can be assigned spatial information that defines scale as a function of position within the digital photograph. For example, a picture of a room could include information describing the shape/area of the floor in the picture to permit the viewer to compute digital photograph orientation, scale, and/or alignment for all points within that area. In that way, the viewer software can place digital photographs in the picture, while maintaining a realistic sense of depth, position, and dimension.  
       [0019] The viewer can also implement special display abilities for known types of objects to enhance the functionality of the system, generally with the aim of enhancing the realism of the virtual space. For example, a digital photograph of a wheel on a bicycle could be rotated to simulate motion or a simulated shadow cast by an object (simulated by the viewer software) could be varied to simulate variations in the virtual light source.  
       [0020] The viewer can maintain information for each digital photograph that links to or otherwise refers to another server system. This information can vary in detail, but in general may be used to add an item to a purchasing system on another server system, or to refer the user to another server system where more information can be obtained. In addition, the viewer might implement a “buy” function, in order to automate the purchase of products related to digital photographs displayed in the viewer. Referential information can potentially be specified by the invention owner or a client. Referential information specification is a function of digital photograph management, specified in previous objects of this invention.  
       [0021] The viewer will accept pre-stored combinations of digital photographs and/or alternative digital photographs, possibly allowing clients and users to pre-assemble suggested and/or favorite combinations. This information could be packaged as a quick link in a web page, in an “email” message, on storage media, some combination of these, or by other means.  
       [0022] The viewer can collect data about its use by the end user, for example but not limited to what digital photographs are viewed, for what duration, and in combination with which other digital photographs. The viewer can automatically send that data to the system, for statistical analysis, and reporting. 
     
    
    
     BRIEF DESCRIPTION OF THE DRAWINGS  
     [0023]FIG. 1 Is a flow chart of overall method acts;  
     [0024]FIG. 2 is a schematic diagram of the present invention embodied as in a network system;  
     [0025]FIG. 3 is a flow chart of the photographic phase, including information and digital photograph construction;  
     [0026]FIG. 4 is a flow chart of the database operation phase;  
     [0027]FIG. 5 is a flow chart of viewer object invocation phase from a referring system;  
     [0028]FIG. 6 is a flow chart of viewer object invocation phase using pre-configuration from a referring application  
     [0029]FIG. 7 is a schematic diagram of the present invention embodied as an example of the viewer object;  
     [0030]FIG. 8 is a flow chart of viewer operation phase;  
     [0031]FIG. 9 is a schematic diagram representing the addition of items to an example of the viewer object;  
     [0032]FIG. 10 is a schematic diagram of combining items in an example of the viewer object  
     [0033]FIG. 11 is a schematic diagram of manually manipulating items in an example of the viewer object  
     [0034]FIG. 12 is a schematic diagram of automatically manipulating items in an example of the viewer object  
     [0035]FIG. 13 is a schematic diagram of showing an enlarged view of an item in an example of the viewer object.  
     [0036]FIG. 14 is a schematic diagram depicting an example of the viewer object making reference to, a system outside of the present invention. 
    
    
     DETAILED DESCRIPTION OF THE INVENTION  
     [0037] The present invention will now be described in detail by reference to the presently preferred embodiment as illustrated in the attached drawings. However, as is well known to those of ordinary skill in the art, many obvious variations may be made to this embodiment without departing from the spirit or scope of the present invention as set forth in the claims.  
     [0038]FIG. 1 is a flow chart of the general operation of the invention&#39;s objects including photography, database construction and viewing. The process of the present invention starts at block  1 . 1 , in which the client (defined as the client of the system owner, and potentially a digital photograph owner or digital photograph buyer) relationship begins. Once the relationship begins, a client account with the system owner is created in block  1 . 2 . Next, the photographic process begins (block  1 . 3 ), and potentially in parallel, the integration of the current invention with the client&#39;s system starts (block  1 . 4 ). After the photographic process, digital photographs are added to the present invention&#39;s database (block  1 . 5 ). Although potentially available earlier, the client may now manage digital photographs (along with their account) in the database system (block  1 . 6 ). After initial digital photograph management is completed, digital photographs are available to users, in the present inventions viewer process object (block  1 . 7 ).  
     [0039]FIG. 2 illustrates the general operation of the present invention in a networked environment.  
     [0040] This figure illustrates the following flow:  
     [0041] ( 1 - 2 ) A digital camera  1  or alternatively a conventional film scanner (not shown in FIG. 2) is used to create image files that are sent to (generally via standard, PC communication port interface) and processed by the system owner&#39;s workstation  2 . At the work station  2 , photograph processing can include but is not limited to image color correction, image background removal, determination of alignment points and image scale, image encryption, and the creation of various resolution versions of an image. The photograph processing may be done by any combination of proprietary and commercially available software products.  
     [0042] ( 2 - 3 ) Image files and associated data files are transferred from the workstation  2  and stored on the system owner&#39;s file server  3 ;  
     [0043] ( 2 - 5 - 6 ) Notification is sent, via email, for example, to Client A at workstation  6  that digital photographs of their item(s) are available for their review, where availability of those image files for outside access (by end-users) is pending their approval.  
     [0044] ( 6 - 5 - 4 - 3 ) Client A accesses the server  3  via the workstation  6 , and reviews and approves the new, digital images via an online interface provided by the system owner. Client A can also specify other, optional attributes for each approved image via this interface.  
     [0045] ( 7 - 5 - 4 - 3 ) An End-User  7  is able to access and view client-approved images. These images, which have been integrated into Client A&#39;s website according to the system owners&#39; instructions, and appear to the end-user as if it is sourced from Client A&#39;s website. The client approved images are viewed via software provided over the internet by the system owner.  
     [0046] ( 8 - 5 - 4 - 3 ) In the event that clients may be granted control over redistribution of some images, where such control is made possible by various objects of the invention, Client B requests the use of a resale-able image from Client A via the workstation  8 .  
     [0047] ( 3 - 5 - 6 ) The server  3  will then send Notification, via email for example, to Client A that Client B has requested to purchase the use of one or more of Client A&#39;s images, pending Client A&#39;s approval.  
     [0048] ( 6 - 5 - 4 - 3 ) Client A logs in to server  3 , and approves the reuse of an image by Client B.  
     [0049] ( 3 - 5 - 8 ) Notification is sent from the server  3 , via email for example, to Client B that Client A has approved the sale of the image.  
     [0050] ( 8 - 5 - 4 - 3 ) Client B logs in to server  3 , and is able to specify their own attributes for the image, originally created for Client A, whose use has been purchased.  
     [0051] ( 7 - 5 - 4 - 3 ) An End-User is able to access and view the resold image, which has been integrated into Client B&#39;s website according to the system owner&#39;s instructions, and appears to the end-user as if it is sourced from Client B&#39;s website.  
     [0052]FIG. 3 is a high-level flow chart illustrating the workflow of the present invention for the general process of photography, the addition of data and generalized color-correction. This flow chart also describes the invention&#39;s general process of adding photographs to the database. Items are received from the client in block  3 . 1 . Color correction data is added to these items, if needed, and the items are then photographed, usually, but not always digitally, (in block  3 . 2 ). The photos are then edited (in block  3 . 3 ), color-corrected, and alignment, textual, ownership, rules, and combination limitation data are added. Then (in block  3 . 4 ) the digital photographs are sent to the database process.  
     [0053]FIG. 4 is a high-level flow chart describing the invention&#39;s general process of database operation, including a representation of the basic digital photograph management process, and account management. In block  4 . 1  the client&#39;s database account is created, and then (in block  4 . 2 ) digital photographs are received from the photographic process. Next, clients can approve or disapprove their use of digital photographs (block  4 . 4 ). If digital photographs are disapproved, the photographic process can begin again and digital photographs are again retuned to the database process for approval. If approved, viewing of digital photographs may be permitted at this time, as depicted by viewer process object (block  4 . 5 ) and/or digital photograph management can be conducted in block  4 . 7 . In block  4 . 7 , clients and/or the invention owner manage accounts and digital photographs. Among other things, these parties can set parameters and rules for digital photographs and the database, which will be enforced by the database and/or the viewing software. They can add and/or select textual data for display with digital photographs, or in the viewer process, they can create and manage user/group accounts and policies, view statistics, account information, billing, and many other types and portions of information. From block  4 . 7 , clients can also affect and/or enable the viewer process shown in block  4 . 5 . Block  4 . 8  depicts statistics being gathered and processed for digital photographs flowing through block  4 . 5 . If in block  4 . 7 , digital photograph resale (shown in block  4 . 10 , and defined as the ability for other specific clients, or groups of clients to buy digital photographs for re-use in the system) is enabled, statistical data may also be sent to block  4 . 8 . Clients can also stop approved digital photographs from being viewed (block  4 . 6 ), or remove digital photographs from the database (block  4 . 9 ).  
     [0054]FIG. 5 is a general flow chart describing how a user could invoke an instance, or instances, of the viewer, from, or in, one or more websites, or server systems. In block  5 . 1 , a user browses, or in some other way accesses a website or server system which has permission to connect to this invention&#39;s database object. In block  5 . 2 , the user invokes the viewer object by clicking on a link, digital photograph, text, or by committing some other action. The viewer object may also be directly integrated with the website or server system, so that no action is needed on the part of the user to invoke the viewer object (block  5 . 3 ). Note that it is possible to invoke multiple instances of the viewer object. Furthermore, it is also possible that invocation actions committed after the first invocation of the viewer may not invoke a new instance of the viewer object, but instead may interoperate with and/or relate to the initially invoked instance of the viewer object. If the viewer is invoked, and is not integrated directly with the website or server system, the viewer is loaded and subsequently displayed on the user&#39;s system (block  5 . 4 ). In block  5 . 5 , the viewer begins operation by indicating what, if any, item the user was interested in when the viewer was invoked. This indication may (or may not) be made by the display of a small digital photograph in the viewer object. Note that if the viewer is integrated directly with the website or server system, it may be pre-configured with a set, or sets of item digital photographs.  
     [0055]FIG. 6 is a flow chart describing how a user could invoke an instance, or instances, of the viewer, from, a referring application, or media, including, but not limited to when the viewer contains a pre-selected and/or pre-configured set of item digital photographs. In block  6 . 1 , a set, or sets, of digital photographs are configured, possibly in some combination, by the client, using tools that are part of the current invention. These sets are placed into an instance of the viewer, which is, in turn, placed in a host system, which may include, but not be limited to electronic mail applications, other applications and/or storage media including, but not limited to, Compact Discs. In block  6 . 2  the user loads the application or media storing the viewer object, which in turn may load and present the viewer object on the user&#39;s display (block  6 . 3 ). Loading the viewer object can be automatic, or manual based on user action. In block  6 . 4 , the viewer begins operation by indicating what, if any, items were pre-configured. This indication may (or may not) be made by the display of a small digital photograph in the viewer object.  
     [0056]FIG. 7 a sample computer screen shot of the system&#39;s viewer object, as it might appear after invocation in as per FIG. 5 or FIG. 6, and from, or in, one or more websites, or server systems.  
     [0057]FIG. 8 is a flow chart describing the operation of the invention&#39;s viewer object, its function, and operation. In block  8 . 1  the viewer invocation process completes, and the viewer is displayed on the user&#39;s system or in a server system. At this point, the viewer may contain one or more digital photographs and/or references, indicating the items the user was interested in and/or the items that the user can take further action with in the viewer object. The user can then load additional items into the viewer object (block  8 . 2 ), and indications of this action will again be made in the viewer by one or more digital photographs and/or references, in order to take actions with those items in subsequent steps. Note that a potentially unlimited number of digital photographs and/or references can be made/shown in the viewer object. Furthermore, additional items can be loaded at any time in the viewer process. In parallel with, or after block  8 . 1 , the user can take actions that will prompt the viewer object to show digital photographs in greater detail (represented in block  8 . 3 ). The digital photographs can be shown individually, combined with other digital photographs, separated, removed, or in other ways, depending on actions taken in block  8 . 3 . The acts of adding, combining, and separating digital photographs can be performed at anytime, and in combination with block  8 . 2 , and all subsequent blocks and actions. From this point, another series of actions can be taken. These actions include, but are not limited to automatic or manual digital photograph manipulation, with one or more digital photographs, potentially in combination (block  8 . 5 ), viewing descriptive or other types of textual data in the system (block  8 . 6 ), the viewing of close up/detail digital photographs from the system (block  8 . 7 ), and the modification of options, including, but not limited to backgrounds, digital photograph sizing, coloration, themes, information specificity level, color calibration and more. Additionally, block  8 . 4 , represents that users can access other systems, including, but not limited to, websites, server systems, and/or purchasing systems. Block  8 . 10  depicts that the viewer object can send statistics related to many user actions to this invention&#39;s object database system Note that user actions in the viewer process are not mutually exclusive, and taking these actions can be performed at anytime after block  8 . 2 , and in any combination.  
     [0058]FIG. 9 is a computer screen shot illustrating the implementation of the present invention as it would be viewed on the end-user&#39;s computer screen. This particular figure illustrates how the end user would choose different types of apparel for display on the computer screen. In this particular embodiment, the items being chosen for display are motorcycle apparel. In the FIG.  9 , the first item chosen is the helmet. The user would use the computer mouse or other pointing device to select the particular helmet from the choices displayed on the left column of the screen. The chosen helmet will then be represented on what would be the head of the person in the main viewing area.  
     [0059]FIG. 10 is another computer screen shot illustrating what will be shown in the main viewing area after additional items of motorcycle apparel are chosen for display. In FIG. 10, the helmet has been combined with gloves, boots and a body suit to illustrate how the various items would appear in combination to an end user. The mixing and matching of various items, possibly from different manufacturers, is an advantage over presently available systems or methods since it allows for a virtually unlimited combination of various items. In this way, the end user can see a computer representation of what he or she may actually look like if the items are actually purchased.  
     [0060]FIG. 11 Is another computer screen shot illustrating how the end user can manipulate the image after combining several items of apparel. In FIG. 11, the image is rotated so that the user can view the combined items of apparel from different perspectives.  
     [0061]FIG. 12 is a series of computer shots illustrating the process of automatically manipulating and combining item digital photographs an example rendition of the viewer object.  
     [0062]FIG. 13 is a computer screen shot illustrating the process of showing an enlarged version digital photograph of an item in an example rendition of the viewer object.  
     [0063]FIG. 14 is a series of computer shots illustrating how items in the viewer object could refer users to, or interoperate with, a purchasing system, or information, from or in a web site, or server system outside of the present invention.  
     [0064] Those of ordinary skill in the art will recognize that the embodiments just described merely illustrate the principles of the present invention. Many modifications may be made thereto without departing from the spirit and scope of the invention as set forth in the following claims.