# Patent

## Title
Automatic learning for mapping spoken/text descriptions of products onto available products

## Abstract

A method, processing device, and machine-readable medium are provided. Costs of states of a state space are calculated. Each state represent one or more available product attributes having zero or more decided attribute values. The calculating is based, at least in part, on training data associated with previously requested and offered products. Determining a next state such that one or more products are available and a sum of values, including a cost of a next state and a cost of a perturbation of one of the one or more requested product attribute values to reach the next state is a minimum value. A value for a product attribute is mapped according to the minimum sum of values and product attribute values of available products.

## Background
PRIORITY INFORMATION
The present application is a continuation of U.S. patent application Ser. No. 11/279,802, filed Apr. 14, 2006, the contents of which is incorporated herein by reference in its entirety.


BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to automatically mapping a description of a product to an available product and more specifically to a system and method for learning how to map a product having one or more requested attribute values to an available product.
2. Introduction
For electronic commerce, a retailer may keep descriptions of products in a structured repository. Customers may browse the repository using a web interface, such as, for example, an Internet browser. When a system is configured to receive speech or text input, customers may describe products they wish to purchase in a manner that may not exactly match a product described in the repository. For example, a customer may describe a product such as brown Bass brand shoes of size 10. In a conventional system, the customer may only be presented with information about products that exactly match the customer's description. If a product that exactly matches the customer's description is not available, then the customer may not be presented with any product information. Thus, product information with respect to a product which is available and which the customer may purchase, such as, for example, a dark brown Bass brand shoe of size 10, will not be presented to the customer. Thus, the retailer loses a possible sale.
SUMMARY OF THE INVENTION
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The features and advantages of the invention may be realized and obtained by means of the instruments and combinations particularly pointed out in the appended claims. These and other features of the present invention will become more fully apparent from the following description and appended claims, or may be learned by the practice of the invention as set forth herein.
In a first aspect of the invention, a method is provided for learning to map requested attribute values onto product attribute values of available products. Costs of states of a state space are calculated. Each state represent one or more available product attributes having zero or more decided attribute values. The calculating is based, at least in part, on training data associated with previously requested and offered products. Determining a next state of the state space such that one or more products are available and a sum of values, including a cost of a next state and a cost of a perturbation of one of the one or more requested product attribute values to reach the next state is a minimum value. A value for a product attribute is mapped according to the minimum sum of values and product attribute values of available products.
In a second aspect of the invention, a machine-readable medium having recorded thereon instructions is provided. The machine-readable medium includes instructions for calculating a cost of a group of states of a state space, where each of the group of states represents one or more available product attributes having decided values, and the calculating is based, at least in part, on training data that associated with previously requested and offered products. The machine-readable medium further includes instructions for determining a next state of the state space such that one or more products are available and a sum of values, including a cost of the next state and a cost of a perturbation of one of the one or more requested product attribute values to reach the next state is a minimum value, and instructions for mapping a value for a product attribute based on a minimum sum of values and product attribute values of available products.
In a third aspect of the invention, a processing device is provided. The processing device includes at least one processor, a storage device including information with respect to a group of products, where the storage device is accessible by the at least one processor, and a memory operatively connected to the at least one processor. The processing device is configured to calculate a cost of a group of states of a state space, where each of the group of states represents one or more available product attributes having decided values, and the calculating is based, at least in part, on training data associated with previously requested and offered products. The processing device is further configured to determine a next state of the state space such that one or more products are available and a sum of values, including a cost of the next state and a cost of a perturbation of one of the one or more requested product attribute values to reach the next state is a minimum value, and map a value for a product attribute according the minimum sum of values and product attribute values of available products.



BRIEF DESCRIPTION OF THE DRAWINGS
In order to describe the manner in which the above-recited and other advantages and features of the invention can be obtained, a more particular description of the invention briefly described above will be rendered by reference to specific embodiments thereof which are illustrated in the appended drawings. Understanding that these drawings depict only typical embodiments of the invention and are not therefore to be considered to be limiting of its scope, the invention will be described and explained with additional specificity and detail through the use of the accompanying drawings in which:
FIG. 1 illustrates an exemplary processing device in which implementations consistent with principles of the invention may execute;
FIG. 2 illustrates an exemplary state space for a product having three attributes;
FIG. 3 illustrates a flowchart of an exemplary process for calculating costs of states of a state space;
FIG. 4 illustrates an exemplary process for mapping requested product attributes to product attributes of available products in one implementation consistent with the principles of the invention; and
FIG. 5 illustrates another exemplary process for mapping requested product attributes to product attributes of available products in another implementation consistent with the principles of the invention.



DETAILED DESCRIPTION OF THE INVENTION
Various embodiments of the invention are discussed in detail below. While specific implementations are discussed, it should be understood that this is done for illustration purposes only. A person skilled in the relevant art will recognize that other components and configurations may be used without parting from the spirit and scope of the invention.
Exemplary System
FIG. 1 illustrates a block diagram of an exemplary processing device 100 which may be used to implement systems and methods consistent with the principles of the invention. Processing device 100 may include a bus 110, a processor 120, a memory 130, a read only memory (ROM) 140, a storage device 150, an input device 160, an output device 170, and a communication interface 180. Bus 110 may permit communication among the components of processing device 100.
Processor 120 may include at least one conventional processor or microprocessor that interprets and executes instructions. Memory 130 may be a random access memory (RAM) or another type of dynamic storage device that stores information and instructions for execution by processor 120. Memory 130 may also store temporary variables or other intermediate information used during execution of instructions by processor 120. ROM 140 may include a conventional ROM device or another type of static storage device that stores static information and instructions for processor 120. Storage device 150 may include any type of media, such as, for example, magnetic or optical recording media and its corresponding drive. In some implementations, storage device 150 may include a database.
Input device 160 may include one or more conventional mechanisms that permit a user to input information to system 200, such as a keyboard, a mouse, a pen, a voice recognition device, a microphone, a headset, etc. Output device 170 may include one or more conventional mechanisms that output information to the user, including a display, a printer, one or more speakers, a headset, or a medium, such as a memory, or a magnetic or optical disk and a corresponding disk drive. Communication interface 180 may include any transceiver-like mechanism that enables processing device 100 to communicate via a network. For example, communication interface 180 may include a modem, or an Ethernet interface for communicating via a local area network (LAN). Alternatively, communication interface 180 may include other mechanisms for communicating with other devices and/or systems via wired, wireless or optical connections.
Processing device 100 may perform such functions in response to processor 120 executing sequences of instructions contained in a computer-readable medium, such as, for example, memory 130, a magnetic disk, or an optical disk. Such instructions may be read into memory 130 from another computer-readable medium, such as storage device 150, or from a separate device via communication interface 180.
Processing device 100 may be, for example, a personal computer (PC), or any other type of processing device capable of processing textual or voice data. In alternative implementations, such as, for example, a distributed processing implementation, a group of processing devices 100 may communicate with one another via a network such that various processors may perform operations pertaining to different aspects of the particular implementation.
Overview
A customer may access a processing device, such as, for example, processing device 100 in a number of different ways. In one implementation, the customer may access processing device 100 using a browser via a network, such as, for example, the Internet. In another implementation, the customer may access processing device 100 via a telephone and may provide speech input to processing device 100. In a third implementation, the customer may access processing device 100 directly via a workstation directly connected to processing device 100.
Once, the customer accesses processing device 100, the customer may provide, as input, one or more requested product attribute values of a product that the customer is interested in purchasing. For example, if the customer is interested in purchasing shoes, the customer may provide requested product attribute values, such as Bass shoes, brown color, size 10. Processing device 100 may then search a product database for a product having the requested product attributes. If one or more products having the requested attribute values is available, then the customer may be presented with information describing the one or more products. However, if no available product can be found that has all of the requested attributes. Processing device 100 may present the customer with information about similar available products. Processing device 100 may determine which available products may interest the customer based on training data including information from previous customer requests. The information may include requested product attribute values Rn={r1, r2, . . . rn}, where n is a number of attributes, offered product attribute values On={o1, o2, . . . on} of an available product, and information with respect to whether a customer purchased the available product.
In implementations consistent with the principles of the invention selection of available products may be done by incrementally deciding the value of each product attribute. In doing so, the requested attribute values may be perturbed. More specifically selection may be done by searching a “state space”. States in this space may represent decided attributes of the product. To enable the search, costs may be assigned to each state and to each perturbation that allows transition from one state to another. Computation of these costs may be based, at least in part, on the above-mentioned training data. Starting from an initial state, where no decisions are made, the procedure may repeatedly transition to a next state by deciding a value of an attribute, possibly by perturbing a requested attribute value, such that total cost of perturbation and the cost of a next state is a minimum amount. In doing so attribute values of a product in the database may be used to perturb the requested attribute values.
State Space
Implementations consistent with the principles of the invention may determine a cost of each state of a state space. FIG. 2 illustrates an exemplary state space 200 for three product attributes. State space 200 may include one or more states having no decided attribute values, S0={202}, one decided attribute value, S1={204, 206, 208}, two decided attribute values, S2={210, 212, 214}, and three decided attribute values, S3={216}. State space 200 is an exemplary state space. Other state spaces may have more of fewer product attributes.
State 202 may represent a starting point, or initial state, in which no attribute values have been decided. State 204 may represent a state in which a value for attribute A is decided. State 206 may represent a state in which a value for attribute B is decided. State 208 may represent a state in which a value for attribute C is decided. State 210 may represent a state in which values for attributes A and B are decided. State 212 may represent a state in which values for attributes A and C are decided. State 214 may represent a state in which values for attributes B and C are decided. State 214 may represent a state in which values for attributes A, B and C are decided.
The cost of a state may be calculated by summing an average cost of deciding an attribute value for remaining undecided attributes. Thus, a cost of state 204, in which a value for attribute A is decided, may equal a sum of an average cost of deciding a value of product attribute B and an average cost of deciding a value of product attribute C.
For example, the cost of state 210, in which attributes A and B are decided may be the average cost of deciding remaining attributes, which in this case is attribute C. This can best be shown by way of an example. In this example, assume that a product, shoes, is being offered for sale and product attribute A corresponds to brand, product attribute B corresponds to color, and product attribute C corresponds to size. In state 210, attributes A (brand) and B (color) are decided. The remaining undecided attribute is size. Thus, the cost of deciding a value for attribute C may be calculated from training data, which may include a set of requested attribute values (three for this example) R3={r1, r2, r3}, a set of offered attribute values (three for this example) O3={o1, o2, o3}, and information indicating whether the requesting consumer purchased the offered item. Each attribute may have a perturbation operator. For a numerical value, such as size, a set of perturbation operators may be, for example, {increase, decrease, same} indicating that an offered attribute value may be, for example, a half size higher than, a half size lower than, and the same size, respectively, as a requested size. For other attributes, such as color, a set of perturbation operators may be values, such as, for example, {black, brown, tan, dark brown, white, cordovan}.
For the sake of this example, assume that the training data has data for one hundred shoe transactions and that sixty of the transactions indicate that consumers requested and were offered the same size shoe and in each of these sixty transactions, respective consumers purchased the product. Then, the probability of making a sale when deciding a value of attribute C that is equal to a requested size is




  
    60
    60
  
  =
  1.




Further, for this example, assume that according to the training data, in thirty transactions respective consumers was offered a half size larger than a requested size and 15 of these transactions resulted in a sale. Thus, the probability of making a sale when deciding a value of attribute C that is a half size larger than the requested size is





  15
  30




or 0.5. Further, assume that in ten transactions, respective consumers requested a size and were offered a size a half size smaller than what was requested. In these ten transaction in the training data, only one resulted in a sale. Thus, the probability of making a sale when offering a shoe that is a half size smaller than a requested size is





  1
  10




From the calculated probabilities, a cost of deciding an attribute value may be calculated according to a formula:

cik=−log(p(qik))  Equation 1

where cik is a cost of deciding a value of an ith attribute according to a kth perturbation of a requested attribute value, qik is a kth perturbation of an ith attribute value, and p(qik) is a probability of selling a product having a value of an ith attribute perturbed according to a kth perturbation. Thus, according to the training data, the cost of selling a shoe having the same size as a requested shoe may be −log(1)=0, the cost of selling a shoe that is a half size larger than a requested size may be −log(0.5)=0.3010, and the cost of selling a shoe that is half a size smaller than a requested size may be −log(0.1)=1. The average cost of deciding a value of an ith attribute may then be determined according to a formula:

    
    
        average cost of deciding attribute
    
    






  
    
      
        
          i
          =
          
            
              
                ∑
                
                  k
                  =
                  1
                
                n
              
              ⁢
              
                
              
              ⁢
              
                (
                
                  
                    N
                    k
                  
                  ×
                  
                    c
                    i
                    k
                  
                
                )
              
            
            
              
                ∑
                
                  k
                  =
                  1
                
                n
              
              ⁢
              
                
              
              ⁢
              
                N
                k
              
            
          
        
        ,
      
    
    
      
        Equation
        ⁢
        
          
        
        ⁢
        2
      
    
  




where Nk is a number of transactions with respect to perturbation operator k and cik is the cost of deciding attribute i with respect to the kth perturbation. Applying equation 2 to the above shoe example, the average cost of deciding a value for attribute C is





  
    
      
        60
        ×
        0
      
      +
      
        30
        ×
        0.3010
      
      +
      
        10
        ×
        1
      
    
    
      60
      +
      30
      +
      10
    
  
  =
  0.1903




FIG. 3 illustrates a flowchart that explains processing for determining costs of states in implementations consistent with the principles of the invention. The process may begin with processing device 100 setting a state to an initial state, S0, indicating a state in which no attributes have decided values (act 300). Next, processing device 100 may set the state to a next state, for example, state 204 (see FIG. 2) (act 302). Processing device 100 may then calculate a cost of the state from training data (act 304). For example, the cost of state 204 may be calculated as a sum of the average cost of deciding attribute B and the average cost of deciding attribute C. This may be calculated according to equations 1 and 2, above. After calculating the cost of the state, the cost may be saved for future use in determining what attribute values to offer to a consumer (act 306), as will be described below. Processing device 100 may then determined whether there are additional states in the state space (act 308). If processing device 308 determines that there are additional states in the state space, then processing device 100 may again perform acts 302-308. Otherwise, the process is completed. In implementations consistent with the principles of the invention, the above-described process of FIG. 3 may be performed once, using the training data, and the respective costs of states saved for use in determining which product attribute values to offer to consumers.
State Space Searching
A consumer may provide a set of requested product attribute values, Rn, for a desired product, such as, for example, shoes, or other products. Processing device 100 may decide which values of attributes to offer, On, to the consumer based on cost. In implementations consistent with the principles of the invention, processing device 100 may offer product attribute values, On, such that the cost is at a minimum and a product having the offered attribute values is available. Assuming that a consumer will always purchase a product having offered product attribute values, On, equal to requested product attribute values, Rn, one can see from equation 1, that the cost in such a case would be 0.
FIG. 4 is a flowchart of an exemplary process that may be performed in implementations consistent with the principles of the invention. Processing device 100 may begin by receiving requested attribute values, Rn, for a desired product (act 402). Processing device 100 may then set a counter, i, indicating a number of decided attribute, to 0 and an initial state to S0 (act 404).
Next, processing device 100 may determine a cost of perturbations to reach all possible next states (act 406). For example, if the current state is S0=202, then the set of possible next states is S1={204, 206, 208}. The cost may be determined based on the training data as explained above, with respect to the shoe example. After determining the cost of a respective perturbation to reach one of the next possible states, processing device 100 may then determine a sum of the cost of the respective perturbation with a cost of the corresponding next state (act 408). In one implementation, the cost of each state may be previously calculated, as explained with respect the flowchart of FIG. 3 and saved for use with the process of FIG. 4. Processing device 100 may then map a requested product attribute, ri, to an offered product attribute value, oi, corresponding to the cheapest sum or total cost, and for which one or more products are available (act 410).
Processing device 100 may then determine whether any additional product attributes values remain to be decided (act 412). If processing device 100 determines that no additional product attribute values remain to be decided, then a set of offered attribute values, On={o1, o2 . . . , on} are selected and products having attribute values On may be offered. Otherwise, 1 is added to i, indicating that an attribute value has been decided (act 414) and the current state, Si, may be set the state corresponding to the cheapest sum or total cost for which one or more products are available (act 416). Processing device 100 may then repeat acts 406-416 until all attribute values are decided. In this way, a cheapest path through the state space is selected based on requested attribute values, Rn, the training data, and available products.
FIG. 5 is a flowchart that describes processing in another implementation of processing device 100 consistent with the principles of the invention. Processing device 100 may begin by receiving requested attribute values, Rn, for a desired product (act 502). Processing device 100 may then set a counter, i, indicating a number of decided attribute, to 0 and an initial state to S0 (act 504).
Next, processing device 100 may determine a cost of perturbations to reach all possible next states (act 506). For example, if the current state is S0=202, then the set of possible next states is S1={204, 206, 208}. The cost may be determined based on the training data as explained above, with respect to the shoe example. Processing device 100 may then determine a number of products, Pk, that have the attributes corresponding to each possible next state (act 507). Processing device 100 may then determine, for each possible next state, a total cost of moving to that state according to a formula

total_cost(Si+1)=ckj−αPk+cost(Si+1),  Equation 3

where ckj is a cost of a kth perturbation of a jth attribute, Pk is the number of products that have the decided attribute values, α is a predetermined constant, and cost (Si+1) is the predetermined cost of the next possible state (act 508). Equation 3 assumes that the probability of a consumer purchasing a product when a large number of products have decided attribute values is high. Therefore in this implementation, a cost of transition from one state to another may be reduced by αPk. α in this equation can be calculated empirically. In one implementation,





  
    α
    =
    
      -
      
        log
        ⁡
        
          (
          
            
              P
              s
            
            
              
                P
                r
              
              ×
              P
            
          
          )
        
      
    
  
  ,




where P is the total number of products, Ps is the number of products sold and Pr is the number of products requested in the training data. Processing device 100 may then map a requested product attribute value, ri, to an offered product attribute value, oi, corresponding to the cheapest total cost for which one or more products are available (act 510).

Processing device 100 may then determine whether any additional product attributes values remain to be decided (act 512). If processing device 100 determines that no additional product attribute values remain to be decided, then a set of offered attribute values, On={o1, o2 . . . , on} are selected and products having attribute values On may be offered. Otherwise, 1 is added to i, indicating that an attribute value has been decided (act 514) and the current state, Si, may be set the state corresponding to the cheapest total cost for which one or more products are available (act 516). Processing device 100 may then repeat acts 506-516 until all attribute values are decided. In this way, a cheapest path through the state space is selected based on requested attribute values, Rn, the training data, and availability of products.
CONCLUSION
The above-described embodiments are exemplary and are not limiting with respect to the scope of the invention. Embodiments within the scope of the present invention may include computer-readable media for carrying or having computer-executable instructions or data structures stored thereon. Such computer-readable media can be any available media that can be accessed by a general purpose or special purpose computer. By way of example, and not limitation, such computer-readable media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices. When information is transferred or provided over a network or another communications connection (either hardwired, wireless, or combination thereof) to a computer, the computer properly views the connection as a computer-readable medium. Thus, any such connection is properly termed a computer-readable medium. Combinations of the above should also be included within the scope of the computer-readable media.
Computer-executable instructions include, for example, instructions and data which cause a general purpose computer, special purpose computer, or special purpose processing device to perform a certain function or group of functions. Computer-executable instructions also include program modules that are executed by computers in stand-alone or network environments. Generally, program modules include routines, programs, objects, components, and data structures, etc. that perform particular tasks or implement particular abstract data types. Computer-executable instructions, associated data structures, and program modules represent examples of the program code means for executing steps of the methods disclosed herein. The particular sequence of such executable instructions or associated data structures represents examples of corresponding acts for implementing the functions described in such steps.
Those of skill in the art will appreciate that other embodiments of the invention may be practiced in networked computing environments with many types of computer system configurations, including personal computers, hand-held devices, multi-processor systems, microprocessor-based or programmable consumer electronics, network PCs, minicomputers, mainframe computers, and the like. Embodiments may also be practiced in distributed computing environments where tasks are performed by local and remote processing devices that are linked (either by hardwired links, wireless links, or by a combination thereof) through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.
Although the above description may contain specific details, they should not be construed as limiting the claims in any way. Other configurations of the described embodiments of the invention are part of the scope of this invention. For example, hardwired logic may be used in implementations instead of processors, or one or more application specific integrated circuits (ASICs) may be used in implementations consistent with the principles of the invention. Further, implementations consistent with the principles of the invention may have more or fewer acts than as described, or may implement acts in a different order than as shown. Accordingly, the appended claims and their legal equivalents should only define the invention, rather than any specific examples given.

## Claims

1. A computer-implemented method for mapping requested product attribute values onto product attribute values of available products, the method comprising:
calculating, via a processor of the computing device, a cost of deciding a plurality of states of a state space, each of the plurality of states representing one or more available product attributes having zero or more decided attribute values, wherein calculating the cost is based on training data associated with previously requested and offered products;
determining, via the processor of the computing device, a next state of the state space such that one or more products are available and a sum of values, including a cost of deciding the next state and a cost of a perturbation of one or more requested product attribute values to reach the next state, is a minimum value, the cost of perturbation being calculated based on a kth perturbation of an ith product attribute value, and a probability of selling a product having a value of an ith attribute perturbed according to the kth perturbation of the ith product attribute value; and
mapping, via the processor of the computing device, a value for a product attribute according to the minimum sum of values and product attribute values of available products.

2. The computer-implemented method of claim 1, the method further comprising:
updating a current state to correspond to the determined next state based on an associated mapped value; and
repeating the determining of a next state, the mapping of the value for the product attribute, and the updating of the current state until all of the one or more requested product attribute values are mapped to available product attribute values; and
offering at least one of the one or more available products having the mapped values of the product attributes.

3. The computer-implemented method of claim 1, wherein determining the next state further comprises:
adjusting the sum of values by subtracting a number of available products that have the one or more product attribute values multiplied by a predetermined value.

4. The computer-implemented method of claim 1, wherein calculating the cost of the plurality of states further comprises:
for each respective one of the plurality of states, using the training data to determine the average cost of deciding a value of each remaining respective one or more undecided available product attributes; and
summing the determined average costs.

5. A non-transitory machine-readable storage medium storing instructions which, when executed by a computing device, cause the computing device to map requested product attribute values onto product attribute values of available products, the instructions comprising:
calculating a cost of deciding a plurality of states of a state space, each of the plurality of states representing one or more available product attributes having zero or more decided values, wherein calculating the cost is based on training data associated with previously requested and offered products and a summing of an average cost of deciding an attribute value for remaining undecided attributes;
determining a next state of the state space such that one or more products are available and a sum of values, including a cost of deciding the next state and a cost of a perturbation of one or more requested product attribute values to reach the next state is a minimum value, the cost of perturbation being determined based on a kth perturbation of an ith product attribute value, and a probability of selling a product having a value of an ith attribute perturbed according to the kth perturbation of the ith product attribute value; and
mapping a value for a product attribute based on a minimum sum of values and product attribute values of available products.

6. The non-transitory machine-readable storage medium of claim 5, the instructions further comprising:
updating a current state to correspond to the determined next state based on an associated mapped value; and
repeating the determining of a next state, the mapping of the value for the product attribute, and the updating of the current state until all of the one or more requested product attribute values are mapped to available product attribute values; and
offering at least one of the one or more available products having the mapped values of the product attributes.

7. The non-transitory machine-readable storage medium of claim 5, wherein the instructions for determining the next state further comprise:
adjusting the sum of values by subtracting a number of available products that have the one or more product attribute values multiplied by a predetermined value.

8. The non-transitory machine-readable storage medium of claim 5, wherein the instructions for calculating the cost of deciding the plurality of states further comprise:
using the training data, for each respective one of the plurality of states, to determine the average cost of deciding a value of each remaining respective one or more undecided available product attributes; and
summing the determined average costs.

9. A system for mapping requested product attribute values onto product attribute values of available products, the system comprising:
a processor;
a first module configured to control the processor to calculate a cost of deciding a plurality of states of a state space, each of the plurality of states representing one or more available product attributes having zero or more decided attribute values, wherein calculating the cost is based on training data associated with previously requested and offered products;
a second module configured to control the processor to determine a next state of the state space such that one or more products are available and a sum of values, including a cost of deciding the next state and a cost of a perturbation of one or more requested product attribute values to reach the next state is a minimum value, the cost of perturbation being calculated based on a kth perturbation of an ith product attribute value, and a probability of selling a product having a value of an ith attribute perturbed according to the kth perturbation of the ith product attribute value; and
a third module configured to control the processor to map a value for a product attribute according to the minimum sum of values and product attribute values of available products.

10. The system of claim 9, further comprising:
a fourth module configured to control the processor to update a current state to correspond to the determined next state based on the mapped value for the product attribute; and
a fifth module configured to control the processor to repeat the determining of a next state, the mapping of the value for the product attribute, and the updating of the current state until all of the one or more requested product attribute values are mapped to available product attribute values; and
a sixth module configured to control the processor to offer the one or more available products having the mapped values of the product attributes.

11. The system of claim 9, wherein the second module is further configured to control the processor to adjust the sum of values by subtracting a number of available products that have the one or more product attribute values multiplied by a predetermined value.

12. The system of claim 9, wherein the first module is further configured to control the processor to:
use the training data to determine the average cost of deciding a value of each remaining respective one or more undecided available product attributes for each respective one of the plurality of states; and
sum the determined average costs.