Method and apparatus for use in a vending machine

During operation of a vending machine, an image is obtained of an area of interest in the vending machine. As a product selected by a customer moves toward a product retrieval location, images of the area of interest are obtained and transmitted to the data base. Images in the data base are compared to determine whether or not the selected product has moved to the area of interest.

BACKGROUND OF THE INVENTION

The present invention relates to a new and improved method and apparatus for use in a vending machine which dispenses products to customers.

Vending machines have been utilized to provide various snacks, beverages and other products to customers. The vending machines dispense selected products to customers in response to insertion of money, which may be paper and/or coins, into the machines. Known vending machines may be similar to vending machines disclosed in U.S. Pat. Nos. 5,303,844 and 6,732,014.

These known vending machines are periodically stocked with products which are to be dispensed to customers. During stocking, the products are positioned in dispensing devices. Each of the dispensing devices holds a plurality of products which are sequentially moved from storage locations to a dispensing location. Customer readable indicia indicates the location of the product associated with each of the dispensing devices.

When a customer has selected a product, the customer inserts money or a credit card into the known machine. In addition, the customer actuates a selection switch panel to indicate the location of the product which has been selected. When this has occurred, a dispensing device for the selected product is operated and the selected product moves from a dispensing location to a product retrieval location. The customer manually retrieves the product at the product retrieval location.

Known dispensing devices have included one or more helical conveyors. These conveyors have sequentially moved products from storage locations to dispensing locations. Other dispensing devices have utilized other types of conveyors, for example, dividers or pusher members may be connected with a conveyor belt or chain and moved with the belt or chain to sequentially move products from storage locations to a dispensing location. Other known dispensing devices use gravity feed of products.

After a vending machine has been in operation for a period of time, it is necessary to restock the vending machine with products to be sold. When this is to be done, a supply of each of the products for a vending machine is transported to the vending machine. The dispensing devices are then stocked with new products or with products which correspond to products which were previously sold. In restocking the vending machine, products which sell for the same price and which are identical to other products in a dispensing device are positioned in the dispensing device.

SUMMARY OF THE INVENTION

The present invention provides a vending machine having a plurality of product dispensing devices. Each of the product dispensing devices holds a next product to be dispensed from the dispensing device and a plurality of products which are located at product storage locations in the product dispensing device. The products at the storage locations are sequentially moved to the product dispensing location.

When a customer selects a product, the product is moved from one of the product dispensing locations to a product retrieval location where the customer has access to the selected product. The selected product moves from one of the product dispensing devices along a path which extends to the product retrieval location. In accordance with one of the features of the present invention, an image of the selected product is obtained as the selected product moves along the path toward the product retrieval location.

As the selected product moves along the path toward the product retrieval location, a plurality of images of a selected portion of the path are sequentially obtained and transmitted to a data base. Each of the images is compared to an image in a data base to determine when a product has moved into the image. In response to movement of the product into the image, controls in the vending machine determine that a product has moved to the product retrieval location.

The present invention has a number of different features. These features may be utilized together as disclosed herein. These features may be utilized separately and/or in various combinations with each other or the prior art.

DESCRIPTION OF SPECIFIC EMBODIMENTS OF THE INVENTION

General Description

A vending machine10(FIG. 1) is constructed and operated in accordance with the present invention. The vending machine10includes a rectangular housing12having side walls14and a door16. The door16has a transparent window or panel20. The door16is pivotally mounted on hinges (not shown) connected to the side walls14in a known manner.

Disposed within the housing12are a plurality of product dispensing devices24. The product dispensing devices24are visible through the glass window20in the door16. InFIG. 1, the product dispensing devices24are all shown as being empty, that is, before the product dispensing devices are stocked with products28(FIG. 2). It should be understood that the product dispensing devices may have any desired construction and be used to dispense any desired product. It should also be understood that the door16may not have a transparent window through which the product dispensing devices24are visible.

The location of the product dispensing devices24in the vending machine10is indicated by indicia32(FIGS. 1 and 2). The indicia32is associated with each of the dispensing devices24. The indicia32indicates the location of the dispensing devices24in the machine10.

In the illustrated embodiment of the invention, the indicia32is of the alpha numeric type. The indicia32includes a letter which designates the row in which a dispensing device is found in the vending machine10. Thus, the rows are designated A, B, C, D, E, and F. The numerals in the indicia32indicate the position of the dispensing devices24in the particular row. Thus, A1indicates the first product dispensing device24in the upper row of product dispensing devices. The indicia32may include two numbers instead of a letter and a number. Alternatively, the indicia32may include two letters instead of a letter and a number.

In addition to the indicia32, an electronically changeable price display36(FIG. 2) is provided in association with each of the dispensing devices24. The price display36indicates the price of the next product28to be dispensed by the dispensing device. The indicia32and the price display36are clearly visible to a potential customer through the transparent window20in the door16.

If desired, the vending machine10may have a door which blocks a potential customer's view of the dispensing devices24. If this is done, the price display36would be visible on the front of the vending machine along with indicia indentifying the products with which the prices are associated.

Each of the dispensing devices24includes a conveyor assembly40(FIG. 2) which engages the products28. Each of the conveyor assemblies40has a known construction. Each of the illustrated conveyor assemblies40includes a pair of helical conveyor elements42and44which engage the products28. The helical conveyor elements42and44are rotatable about their parallel longitudinal central axes relative to a tray48on which the products28are disposed. The helical conveyor elements42and44may be referred to as “spirals”. If desired, a conveyor assembly40may include only single conveyor element42or44.

When a product28is to be dispensed from a product dispensing location54and a next succeeding product is to be advanced from a storage location52(FIG. 2) to the product dispensing location, the helical conveyor elements42and44are rotated in opposite directions about their longitudinal central axes. Thus, the conveyor element42is rotated in a counterclockwise direction (as viewed inFIG. 2) about its longitudinal central axis while the conveyor element44is rotated in a clockwise direction about its longitudinal axis.

This rotation of the two conveyor elements42and44is effective to move the product28at the dispensing location54off of the tray48so that the product drops downward between the trays48and the window20in the door16(FIG. 1). The dispensed product28drops onto a shelf (not shown inFIGS. 1-4) at a product retrieval location60(FIG. 1) in the vending machine10. The customer then manually pivots a delivery door62to gain access to the product on the shelf. At the same time, the conveyor elements42and44move a next succeeding product28from a product storage location52to the product dispensing location54(FIG. 2). If desired, a product retrieval location60having a different construction may be utilized.

Although the illustrated conveyor assemblies40utilize helical conveyor elements42and44to sequentially move products28forward from storage locations52toward the product dispensing location54, one or more of the conveyor assemblies40may include only a single helix. A different type of conveyor assembly may be utilized if desired. For example, indexing or pusher elements may be connected with a continuous belt or chain conveyor and utilized to push the products28to the dispensing location54and then to push each product in turn from the dispensing location. Alternatively, a circular disc may be intermittently rotated to move products28to a dispensing location. The disc may be rotated to dispense a product from the dispensing location. As another example, a gravity feed conveyor may be utilized.

The products28have been illustrated inFIG. 2as being bags which hold the product being dispensed, for example, potato chips or popcorn. However, the product28may be different from the illustrated product. For example, the product may be containers (bottles and/or cans) of liquid, candy bars, video tapes, or compact discs. It should be understood that any one of many different types of known conveyor assemblies may be utilized in place of the conveyor assembly40to dispense many different known products in place of the illustrated products28.

A control panel70(FIG. 1) is mounted on the door16of the vending machine10. The control panel70includes various items with which a customer interacts to purchase one or more products being sold by the vending machine10. The control panel70includes a bill validator insert74where paper money may be inserted into the vending machine10. In addition, the control panel70includes a coin insert76where coins may be inserted into the vending machine10. If used, a coin scavenger button78is manually actuatable to have coins returned at a coin return80. Rather than depositing money, a credit/debit card may be used to pay for a purchase. A credit display window82indicates the amount of money which has been deposited or charged.

A selector switch keyboard84is manually actuatable to enable a product letter and number, corresponding to the indicia32associated with the products, to be entered. When the indicia corresponding with a desired product is entered at the keyboard84, a product dispensing device24for the selected product is activated to move the selected product28from the dispensing location54. Operation of the selected product dispensing device is also effective to move a next succeeding product28to the product dispensing location54.

As the selected product moves from the product dispensing location, it falls downward to the product retrieval location60. If the customer is entitled to change from the money which was inserted into the machine, the change is returned at the coin return80. It should be understood that the selected product28may reach the product retrieval location60in ways other than falling. For example, the product could be scooped up or set on a shelf. If desired various elevators or X/Y delivery systems may be used.

In addition, the control panel70includes a display88where indicia relative to a selected product28may be displayed. This indicia may indicate the characteristics of the selected product, such as the number of calories, ingredients and/or food value. If desired the display88may be omitted.

The illustrated vending machine10has the same general construction and mode of operation as a Model 148 which is commercially available from Crane-National Vendors having a place of business at 12955 Enterprise Way, Bridgeton, Mo. 63044. However, it should be understood that the vending machine10may have a different construction. The features of the invention are not to be considered as being limited to vending machines made by Crane-National Vendors or to any specific type of vending machine.

Product Imaging

A plurality of imaging devices100are provided to obtain visual images of the next products28to be dispensed. The next products28to be dispensed are the products at the dispensing locations54(FIG. 2) in each of the dispensing devices24.

In the illustrated embodiment of the invention, the imaging devices100are disposed on an inner side surface106of the window20(FIGS. 1 and 3). The window mounted imaging devices100face inward toward the product dispensing devices24. It should be understood that the imaging devices100may be positioned at locations other than on the transparent panel of the window20. For example, the imaging devices100may be mounted on the housing12and/or frame of the door16.

In the illustrated embodiment of the vending machine10, the door16has a transparent window20on which the imaging devices are mounted. However, the door16may be opaque. If this is the case, the imaging devices100may be mounted on an opaque panel on the inside of the door16.

In the illustrated embodiment of the invention, the imaging devices100are color digital camera modules. The imaging devices100convert a visual image, which may be referred to as an optical image, to an electrical signal. The specific imaging devices100illustrated inFIG. 3are color digital cameras which are commercially available from STMicroelectronics having places of business at 1000 E. Bell Road, Phoenix, Ariz. 85022, USA and at 39, Chemin du Champ des Filles, C.P. 21, CH 1228 Plan-Les-Ouates, Geneva, SWITZERLAND and is commercially available under the designation of ST VL6624/VS6624. It should be understood that imaging devices other than this specific imaging device may be utilized if desired. Thus, any imaging device which converts a visual (optical) signal to an electrical signal may be utilized.

Controls106(FIG. 4) are connected with the product dispensing devices24, imaging devices100, and control panel70. The controls106effect operation of each of the imaging devices100to obtain initial images of all the products28(FIG. 2) disposed at the dispensing locations54each time the vending machine10is stocked with products28. Thus, a visual image of each of the products at the dispensing locations54in all of the product dispensing devices24in the vending machine10is obtained by activating each of the imaging devices100upon completion of stocking of the vending machine10. The controls106are disposed in the housing12.

Thereafter, only an imaging device100associated with a product location indicated by the indicia32(FIG. 2) of a product dispensed from the vending machine10is activated. Thus, after a product28has been dispensed from a product dispensing device24and a next succeeding product has been moved to the product dispensing location54, only one imaging device100(FIGS. 1,3and4) is activated to obtain a visual image of the product28which was just moved from a storage location52to a product dispensing location54(FIG. 2). If desired, more than one imaging device100may be activated to obtain more than one image of the product28which was just moved to a product dispensing location.

After the vending machine10has been stocked, all of the imaging devices100are activated to obtain images of all of the products28at all of the product dispensing locations54. Thereafter, each time a product28is dispensed from a product dispensing location54and a next succeeding product has been moved from a storage location52to a dispensing location, only one of the imaging devices100is activated to obtain an image of the next succeeding product28which was moved to a product dispensing location54. As was previously mentioned, more than one imaging device100may be activated to obtain images of the next succeeding product28which is moved to a product dispensing location54.

When a product28(FIG. 2) is dispensed from the product dispensing location54, the product drops downward (as viewed inFIG. 1) between the window20and the trays48(FIG. 2) of product dispensing devices24. As the product28moves downward to the product retrieval location60, an imaging device110(FIG. 4) is activated to obtain an image of the product while it is dropping and/or while it is at the retrieval location60. The imaging device110is a color digital camera and has the same construction as the imaging devices100. As was previously mentioned, the product28may be moved to the retrieval location in a manner other than by falling downward.

Rather than using an imaging device110to detect dispensing of a product28, a different product detection system may be utilized to detect dispensing of a product. For example, a product drop detection system similar to the system disclosed in U.S. Pat. No. 6,920,372 may be utilized. Of course other known product drop detection systems may be utilized if desired, such as Is VendWizard™ available from Vendor Exchange International, Inc. in Cleveland, Ohio.

Although only a single imaging device110for obtaining an image of a product28at the product retrieval location60is illustrated inFIG. 4, it should be understood that a plurality of imaging devices110may be provided in the vending machine10. For example, an imaging device110may be mounted on the right side of the housing12(FIG. 1) and a second imaging device110may be mounted on the left side of the housing to obtain views of the product retrieval location60and a dispensed product from different locations. If desired, the imaging devices110for imaging the product as it drops and/or is at the retrieval location60may be mounted on the window20of the door16rather than the housing12.

The imaging devices100and110convert an optical image of a product28to an electrical signal which is representative of the image. The electrical signals corresponding to images of product28are transmitted from the imaging devices100and110to a computer114(FIG. 4) in the controls106. A comparator116compares features of the images represented by the electrical signals transmitted from the imaging devices100and110to a data base120of features. By comparing the electrical signals representative of the visual (optical) images obtained with the imaging devices100and110to the data base120, the identity of a product28corresponding to a visual image obtained by an imaging device can be determined.

The data base120includes a product price data base122. Once the identity of a product28has been determined, the price of the product can be determined from the product price data base122. The computer114compares the price of a product28, as determined by the data base120, with the price set forth at the display36associated with the product. If the price set forth at the display36is different than the product price, as determined by the data base120, the computer114changes the display to agree with the price determined by the data base.

If desired, once the identity of a product has been determined, the computer can reset the price at the display36without comparing the price of the product to the displayed price. This would result in the display36being reset automatically each time the identity of a product is determined. When the display is reset, the displayed price may or may not change.

The display36may include liquid crystal display components or light emitting diode components. The display is electrically energized to set forth the correct price of the product at the dispensing location54associated with the display. The display36may be energized by the computer114to set forth the price of a product, in a known manner, with seven segment numerals. It should be understood that the display36may have any desired construction so long as the computer114can effect a change in the price set forth at the display.

As was previously mentioned, the display36may be disposed on the outside of the vending machine10. If this is done the door16may be constructed so as to block a customer's view of the dispensing devices24. The imaging devices100would be disposed inside the vending machine10and would not be visible to a customer.

When a product28is dispensed from the dispensing location54(FIG. 2), a next succeeding product is moved from a storage location52to the dispensing location. Thereafter, at least one of the imaging devices100(FIGS. 1 and 4) is activated to obtain a visual image of the next succeeding product28which is moved to the product dispensing location54. If desired, a plurality of imaging devices100may be activated to obtain a plurality of images of the next succeeding product28. The computer114(FIG. 4) effects operation of the comparator116to compare the image or images of the next succeeding product to the data base120. This enables the identity of the next succeeding product to be determined.

Once the identity of the next succeeding product moved to a dispensing location54has been determined, the price of the product can also be determined from the product price data base122. The computer114compares the price indicated by the price display36with the price of the next succeeding product as determined by the data base120and visual image of the product. If the price indicated by the price display36is different than the price determined from the product price data base122, the price indicated by the price display36is changed to indicate the correct price for the product which is moved from the storage location to the dispensing location54. This enables products having different prices to be sequentially dispensed from the same dispensing location54while indicating the correct price for the particular product which is at the dispensing location and obtaining the correct amount of money from a customer who selects that product.

When the price at a display36is changed, the amount of money which a customer must pay for the associated product changes. When a customer selects the product, the computer114causes the control panel70to require the correct amount of money for the product. Thus, when the price display36is changed, corresponding changes are made in the amount required at the control panel70.

Images obtained by activating the imaging devices100and110(FIG. 4) are identified by comparing the images obtained from the imaging devices with the data base120. The data base120includes an aspect ratio data base126which contains data corresponding to the aspect ratio of each of the products28(FIG. 2) to be dispensed from the vending machine10. The aspect ratio of a product is the ratio of the product image height divided by the product image width for a particular product. If desired, the imaging devices110may be eliminated. If this is done, other product detection devices may be substituted for the imaging devices110.

It is contemplated that many different products28will be dispensed from the vending machine10. These products may have different aspect ratios. For example, the aspect ratio of a candy bar will be substantially different than the aspect ratio of a bag containing chips or other articles. Similarly, the aspect ratio of beverage containers will be substantially different than the aspect ration of a bag containing a solid food product. The aspect ratio of an image obtained with an imaging device100or110is compared to the aspect ratios in the aspect ratio data base126(FIG. 4) to assist in identifying the product in the visual image obtained by an imaging device100or110.

A color histogram data base130(FIG. 4) contains representations of frequency distributions of colors corresponding to the colors of all the products28sold in the vending machine10. The color histogram for a particular product28is obtained by counting the number of pixels of each of a given set of color ranges in two dimensional color space. The color space of the image is partitioned into a number of spaces, for example eight spaces. For each partition, the pixels with a color within the range of the partition are counted. This results in a representation of the relative frequency of the colors of the visual image of a product obtained with an imaging device100or110.

The color histogram for a particular product28is a representation of the distribution of colors in an image of the product. The color histogram is derived by counting the number of pixels of each of a given set of color ranges in a color space. The histogram provides a compact summarization of the distribution of data relating to color in an image. The color histogram of an image is relatively invariant with translation and rotation about a viewing axis. By comparing histograms of two images and matching the color content of one image with the other, the color histogram is particularly well suited to the problem of recognizing an object of unknown position and rotation.

In addition to the aspect ratio data base126and color histogram data base130, the data base120includes a scale invariant feature data base132(FIG. 4). The scale invariant feature data base132is a data base of product features which are invariant to image scaling and rotation. In addition, these features are at least partially invariant to changes in illumination and view point of the imaging devices100and110.

In comparing features of an image of a product28to the data base132, the image is matched by comparing each feature from the image to the data base and finding matching features based on Euclidian distance of the feature vectors. The manner in which scale invariant features are utilized in the data base132is similar to the description in U.S. Pat. No. 6,711,293 to David G. Lowe and entitled Method and Apparatus for Identifying Scale Invariant Features in an Image and Use of Same for Locating an Object in an Image. The disclosure in the aforementioned U.S. Pat. No. 6,711,293 is hereby incorporated herein in its entirety by this reference thereto.

It should be understood that the data base120may identify products by comparing features other than aspect ratio, color and scale invariant features. For example, a bar code or other encoded data on a product28may be used alone or in combination with various features of a product to identify the product. It is contemplated that various combinations of encoded data, pixel data, metadata and other data may be utilized to identify the products.

In addition to the data base120, the controls106include a transmitter136which is operable to transmit a signal, indicated schematically at138inFIG. 4, to a base station which is remote from the vending machine10. The signal138transmits to the base station the identity and number of products sold. In addition, the signal138may indicate the total amount of money which was collected from customers making the sales. Alternatively, the signal38may transmit the identity and number products sold.

The base station would be able to determine the amount of money collected from customers as a function of the known price of the various products. Thus, the signal138may indicate the number of each of the products sold and the cost of each of those products. The base station may be in a building and/or vehicle.

Based on the information which is transmitted from the vending machine10by the transmitter136, the number of each product sold can be determined. To facilitate restocking, this information is utilized to prepare a kit or group of products containing numbers of each product corresponding to the number of each product which were sold from the vending machine10. When the vending machine10is to be restocked, this kit or group of products is taken to the vending machine and is utilized to replace the products that were previously sold from the vending machine. In addition, the amount of money to be collected from the vending machine10during restocking can be determined from the information provided by the signal138.

If desired, DEX (Data Exchange Uniform Code Standard) may be utilized with the controls106. The transmitter136would transmit data in regard to the identity and number of each product28sold, the amount of money collected, the service history of the vending machine10, and other information. In addition, the data transmitted by the transmitter136would indicate products28which are not selling well. Associated software may suggest that if one particular product28is selling well that another product, if stocked in the vending machine10, will sell well.

Operation

When the vending machine10(FIG. 1) has been in use for a period of time, it is contemplated that the vending machine will have to be restocked with products28(FIG. 2) to be sold from the vending machine. When this is to be done, data transmitted from the vending machine10by the transmitter136(FIG. 4) to a base location will be reviewed. When this is done, the identity and number of each of the products which have been sold from the vending machine are determined. The data transmitted from the vending machine10eliminates the need to rely upon restocking data which is of questionable validity. The base location may be a warehouse and/or vehicle (truck).

A kit or box of products corresponding to the identity and number of products which have been sold from the vending machine10will then be prepared. The number of each of the various products28sold from the vending machine10is determined and a similar number of each of the various products is placed in the box or kit. This will enable a person who is restocking the vending machine10to replace each product which has been sold from the vending machine without transporting excess products.

When the vending machine10is to be restocked, a combination door handle and lock144(FIG. 1) is actuated and the door16is pivoted to an open condition. When the door16has been opened, access is provided to the product dispensing devices24. The person restocking the product dispensing devices24can readily position products28from the kit or box of products in empty storage locations52in the product dispensing devices.

It is contemplated that most of the product dispensing devices24will contain only one specific product28. However, if desired, a variety of products may be provided in one of the product dispensing devices24. These variety of products may have a variety of different prices.

Thus, bags of chips selling for seventy-five cents, bags of candy selling for eighty-five cents, and bags of other articles selling for one dollar may all be positioned in storage locations52in a single product dispensing device24. During restocking of the vending machine10, a product may inadvertently be placed in one product dispensing device24when it should have been positioned in a different product dispensing device. The controls106(FIG. 4) will identify each of the products28to be dispensed. The controls106will effect any necessary changes in the price display36(FIG. 2) associated with a product28at a dispensing location54to indicate the correct price for the product.

Once the product dispensing devices24have been restocked, that is, have been filled with products to be sold, the door16is moved from the open position to a closed position. As the door16is closed, a switch148(FIG. 3) is actuated. Actuation of the switch148indicates to the computer114(FIG. 4) that the door has been closed and restocking of the vending machine completed.

The switch148(FIG. 3) may be connected to the main power supply for the vending machine. When the door16is opened, the switch148opens and interrupts the power supply. When the door16is closed, the switch148closes and reconnects the power supply. Alternatively, the switch148may be connected with just the computer114and not the main power supply. A suitable sensor, to detect opening and closing of the door16may be utilized in place of the switch148. Alternatively, a button or switch may be manually actuated after the door16is closed.

When the door closes, the computer114(FIG. 4), initiates operation of the imaging devices100to obtain images of the products at the dispensing locations54in all of the product dispensing devices24. The imaging devices100convert the visual (optical) images of the products28at the product dispensing locations54in the product dispensing devices24to electrical signals. These electrical signals are representative of the images of the products28.

The electrical signals are transmitted from all of the imaging devices100to the computer114(FIG. 4). The computer114initiates comparison of features of the images represented by the electrical signals with data in the data base120. This comparison enables the computer114to determine the identity of each of the products28at each of the product dispensing locations54in the product dispensing devices24.

To identify a product28at a dispensing location54, the aspect ratio of the image of the product to be identified is compared to aspect ratios in the aspect ratio data base126. The image of the product28to be identified is compared to the color histograms in the color histogram data base130for images having aspect ratios corresponding to the aspect ratios associated with the images of the product28to be identified. The scale invariant features of the image are compared to the scale invariant feature data base132for images having aspect ratios and color histograms corresponding to scale invariant feature data in the data base132. It should be understood that the image of a product may be compared to the data bases126,130and132in any desired order.

The identity of each of the products28at each of the product dispensing locations54is determined in this manner. Once the identity of each of the products at each of the product dispensing locations54has been determined, the price of each product is determined from the product price data base122. If the display36for a particular product is not in agreement with the product price for the product which was identified as being present at the product dispensing location54, the price display36is changed to indicate the correct product price.

Once the foregoing initialization of the vending machine10has been accomplished by identifying the next product28to be dispensed from each of the product dispensing locations54in each of the product dispensing devices24and after the price displays36have been set to the correct amounts, the vending machine10is ready to serve customers. When a customer approaches the vending machine10, the products28at the product dispensing locations54(FIG. 2) in the product dispensing devices24are illuminated by a cabinet light assembly152(FIG. 3). The customer views the products28and the price displays36through the transparent window20in the door16of the vending machine10.

The cabinet light assembly152may have any desired construction. The cabinet light assembly132may have a vertical axis. The cabinet light assembly132may be mounted on the side walls14of the housing12.

After a customer has selected a particular product, he inserts money to pay for the product into the control panel70(FIGS. 1 and 4). Paper money is inserted at the bill validation insert74. Coins are inserted at the coin insert76. A location maybe provided for insertion of a credit/debit card. The customer is informed as to the amount of money which he has deposited into the vending machine by indicia at the credit display window82on the control panel70.

Once the customer has deposited the requisite amount of money into the vending machine10, the customer manually actuates the selector switch keyboard84on the control panel70. The customer actuates keys on the selector switch keyboard84to enter indicia indicative of the indicia32indicating the location of the selected product dispensing device24. The location of the product dispensing device24selected by a customer is transmitted from the selector switch keyboard84to the computer114.

At this time, the display88may set forth indicia indicative of characteristics of the selected product. For example, the display88may indicate the number of calories, other food value information, and/or ingredients of the selected product. In addition, the display88may indicate the brand name of the product and/or special offers or promotions. Of course, if the selected product28is not food, the indicia at the display would indicate the identity of the selected product and features of the product, such as for a booklet, the title and number of pages.

Once the keyboard84has been actuated to enter indicia corresponding to the indicia32indicating the location of the selected product28, the computer114(FIG. 4) effects operation of one or more motors156in the product dispensing device24at the selected product location indicated by the indicia32entered into the keyboard84of the control panel70. The motor156effects rotation of the helical conveyor elements42and44in the selected product dispensing device24. As was previously mentioned, the dispensing devices24may have a different construction if desired. It is contemplated that the dispensing devices24may have any one of many known constructions.

The helical conveyor elements42and44are rotated in opposite directions about their longitudinal central axes. Thus, the helical conveyor element42is rotated in a counterclockwise direction (as viewed inFIG. 2) about its longitudinal central axis while the helical conveyor element44is rotated in a clockwise direction about its longitudinal central axis. Although a single motor156has been shown inFIG. 4as being connected with two helical conveyor elements42and44, a separate motor may be provided for each of the conveyor elements. Of course, one or more of the dispensing devices24may have only a single helical conveyor element.

Rotation of the helical conveyor elements42and44by a motor156(FIG. 4) moves the product28at the selected product dispensing location54off of the tray48(FIG. 2). The selected product28then drops downward from the product dispensing device24to the product retrieval location60(FIG. 1). At the same time, rotation of the helical conveyor elements42and44(FIG. 2) advance the next succeeding product28from a storage location to the product dispensing location54. Similarly, the other products28disposed in storage locations52in the selected product dispensing device24are advanced toward the product dispensing location54by the rotation of the helical conveyor elements42and44.

As the selected product28falls downward to the product retrieval location60, the imaging device110(FIG. 4) is activated to obtain a visual image of the dispensed product. The imaging device110converts the optical image of the dispensed product to an electrical signal which is transmitted to the computer114. The electrical signal transmitted from the imaging device110to the computer114confirms dispensing of a product.

The foregoing description has been in association with dispensing devices24having helical conveyor elements42and44. It is contemplated that the dispensing devices24will have a construction which is adapted to handling of the particular product28to be dispensed. For example, a dispensing device24to be used in association with containers of liquid would have a construction which is different than a dispensing device to be used in association with bags of chips or candy.

The comparator116compares features of the image of the dispensed product to the data base120to determine the identity of the dispensed product. This enables the computer114to confirm that the selected product was indeed dispensed from a product dispensing device24to the product retrieval location60. However, if the image of the dispensed product obtained by operation of the imaging device110is inadequate to enable the comparator116and computer114to determine the identity of the dispensed product, the image will at least confirm that a product was dispensed.

In the unlikely event that the imaging device110does not obtain an image of a dispensed product28, the computer114(FIG. 4) receives an indication of malfunctioning of the selected product dispensing device24. The computer114then effects operation of the selected motor156with a jogging or intermittent operation in a further effort to dispense the selected product28. If this intermittent operation of the motor156is successful, the intermittent or jogging operation of the motor156is interrupted when the imaging device110successfully obtains a visual image of the selected product28at or moving toward the product retrieval location60.

If the intermittent or jogging operation of the motor156is ineffective to cause the product dispensing device24to dispense the selected product28, the computer114changes the display window88to indicate to the customer that another selection is to be made. The computer114gives the customer credit for the money that has already deposited in the vending machine10and allows the customer to make a selection of a product28of equal or lesser cost. Of course, if the product of lesser cost is selected, the computer114effects operation of the vending machine10to refund the excess amount of money which the customer deposited. Alternatively, the computer114could immediately give the customer a refund if a product is not dispensed.

The computer114periodically activates the transmitter136to transmit a signal138(FIG. 4) to a base or remote location. The signal138indicates the identity of the products which have dispensed and indicates the prices of the products. This enables personnel at the base or remote location to determine how much money has been deposited in the vending machine and to determine what products need to be brought to the vending machine in order to restock the vending machine. The transmitter136may be of either the radio or telephone type. Of course, other types of transmitters may be utilized if desired. If desired, the computer114could activate the transmitter136to transmit data in response to a signal from a base station.

During operation of the motor156to rotate the helical conveyor elements42and44in the selected product dispensing device24, the first product28(FIG. 2) is dispensed from the product dispensing location54and a second product moves from a storage location52to the dispensing location (FIG. 2). The second product28which is moved from a storage location52to the dispensing location54may or may not be the same as the product28which was previously at the dispensing location and was selected by a customer.

After a second product has been moved from a storage location52to a product dispensing location54, one of the imaging devices100is activated by the computer114to obtain a visual image of the second product28at the dispensing location54. The computer114activates only the imaging device100which is positioned to obtain a visual (optical) image of the product28at the dispensing location54from which a selected product was previously dispensed. Since a product28was dispensed from only one of the product dispensing locations54, the computer114maintains the imaging devices100associated with other product dispensing locations inactive.

The imaging device100which is activated to obtain a visual image of the second product28at the product dispensing location54converts the optical image to an electrical signal. This electrical signal is transmitted to the computer114. The computer114effects operation of the comparator116to compare features of the visual image of the second product to features in the data base120to determine the identity of the second product.

The identity of the second product28at the product dispensing location54may be the same as the identity of the product which was previously dispensed from the product dispensing location54. However, it is contemplated that the identity of the second product28which replaces the previously dispensed product may be different than the identity of the previously dispensed product. If this is the case, the computer may effect an increase or decrease in the price display36associated with the product dispensing device24in which the second product was moved to the product dispensing location54to replace a previously dispensed product. The price display36associated with this product dispensing device24is changed to indicate the price of the product which is presently at the product dispensing location54, that is, the price of the second product.

It is possible that a dispensing device24may fail to move a product28from a storage location52to a product dispensing location54after a product is dispensed. In the unlikely went that this occurs, activation of an imaging device100to obtain a visual image of the product dispensing location54from which a product was dispensed will result in an image of an empty dispensing location. When the image of an empty product dispensing location54is compared to the data base120by the comparator116, the result is a signal to the computer114indicating the empty dispensing location. In response to this signal, the computer114will effect operation the one dispensing device24having an empty product dispensing location54. This operation of the dispensing device will move a product28from a storage location52to the empty product dispensing location54.

Since the product which is moved from a storage location52to a product dispensing location54in a product dispensing device24is identified each time a product is dispensed from the product dispensing device, different products can be sequentially dispensed from a single product dispensing device24. The price display36is adjusted to accommodate the different prices of different products. This enables different products to either be intentionally or inadvertently positioned in a single product dispensing device24during restocking of the vending machine10.

Images

It is contemplated that an imaging device100may be provided for each of the product dispensing devices24in the vending machine10. The specific vending machine10illustrated inFIG. 1has twenty-four dispensing devices24. Thus, twenty-four imaging devices100may be provided for the vending machine10. Of course, the vending machine10may be provided with either a greater or lesser number of product dispensing devices24and either a greater or lesser number of imaging devices100.

Rather than providing one imaging device100for each product dispensing device24, it is contemplated that it may be desirable to have each imaging device associated with a plurality of product dispensing devices. If each imaging device100is associated with a plurality of product dispensing devices24, the number of imaging devices required for a particular vending machine10is reduced. Of course, this simplifies construction or retrofitting of the vending machine10.

In the vending machine10illustrated schematically inFIG. 1, two product dispensing devices24are associated with each imaging device100. When one of the imaging devices100is activated to obtain a visual (optical) image, the image will be of two product dispensing devices24. These two product dispensing devices24will have two product dispensing locations54in which products28are disposed. This results in the image obtained from one of the imaging devices100being similar to the illustration depicted inFIG. 2.

The half of the image corresponding to the product dispensing device24from which a product was just dispensed is designated by the computer114as being an area of interest. Thus, if a product was dispensed from location A1ofFIG. 2, the left (as viewed inFIG. 2) half of the image obtained by activation of the imaging device100associated with the two product dispensing devices24illustrated inFIG. 2would be of interest. Similarly, if the product had been dispensed from the location designated A2by the indicia32inFIG. 2, the right (as viewed inFIG. 2) half of the image would be designated by the computer114as being the area of interest.

Rather than comparing the images of both the location indicated by the indicia A1and the location indicated by A2with the data base120, only the image in the area of interest is compared with the data base120. Thus, if the product which was dispensed came from the product dispensing location designated A1by the indicia32, only the left (as viewed inFIG. 2) half of the image would be designated as being of interest and would be compared to the data base120. Similarly, if the product which was dispensed came from the product dispensing location designated A2by the indicia32, only the right half of the image would be designated as being of interest and would be compared to the data base120.

Since two product dispensing devices24are viewed by each imaging device100, there are half as many imaging devices100as there are product dispensing devices24. In the specific vending machine10illustrated inFIG. 1, there are twenty-four product dispensing devices24and twelve imaging devices100. Of course, a greater or lesser number of product dispensing devices24may be provided in association with a particular vending machine10. In addition, a greater or lesser number of imaging devices100may be associated with a particular vending machine10.

If desired, the imaging devices100may be constructed and positioned so as to view more than two product dispensing devices24. Thus, a single imaging device100may be constructed and positioned so as to view three or more product dispensing devices24. It is contemplated that an imaging device100may be constructed so as to view ten dispensing devices24. This would enable a vending machine10having forty dispensing devices24to use only four imaging devices100.

In the embodiment of the invention illustrated inFIGS. 1-4, the imaging devices100are positioned so that they view product dispensing devices24disposed on a single tray48, that is, product dispensing devices24at the same vertical level. However, it is contemplated that the imaging devices100may be constructed and positioned so as to view product dispensing devices24on more than one tray48. Thus, the product imaging devices100may be constructed and positioned so as to view two dispensing devices24on each of two trays. In this specific example, the imaging devices may be positioned so as to view product dispensing devices designated A1and A2(FIG. 2) and B1and B2(FIG. 1) disposed immediately beneath the product dispensing devices designated A1and A2.

It is contemplated that each dispensing device24may be viewed by more than one imaging device. For example, each dispensing device24may be viewed by two imaging devices mounted at spaced apart locations in the vending machine10. This would enable the comparator116to compare two different images of a product28at one dispensing location54to the data base120to identify the product at the dispensing location.

Mounting an Imaging Device

In the specific embodiment of the invention illustrated inFIGS. 1-4, the imaging devices100are mounted in a stationary relationship with the product dispensing devices, as long as the door16is closed. Thus, the imaging devices100are mounted on the inner side surface106(FIG. 3) of the transparent window20in the door16. In this embodiment of the invention, the imaging devices100are fixedly secured to the inner side surface106of the window20. This may be done with a suitable adhesive or other fastener.

It should be understood that the imaging devices100may be mounted in a different manner if desired. For example, the window20may be provided with mullions and/or muntins on which the imaging devices100are mounted. Alternatively, some or all of the imaging devices100may be mounted on the frame of the door16or on side walls of the housing12.

In the embodiment of the invention illustrated inFIG. 5, an imaging device100is mounted on a carriage162which is movable along a track164. A drive mechanism, such as a screw or gear drive, may be associated with the carriage162to move it along the track164. It is contemplated that the track164may be mounted on the window20. Alternatively, the track164may be offset to one side of the window20on the door16. If desired, the track164may be mounted on the side walls14of the housing12.

In the embodiment of the invention illustrated inFIG. 5, the track164is stationary relative to the housing12. However, it is contemplated that the track may be movable relative to the housing. For example, one end of the track164may be mounted for pivotal movement relative to the housing12. Alternatively, the track164may be mounted for linear movement relative to the housing12.

In the embodiment of the invention illustrated inFIGS. 1-4, one or more imaging devices110are utilized to image a product as it drops and/or is at the product retrieval location60. In the embodiment of the invention illustrated inFIGS. 6-8, an imaging device obtains an image of the selected product as the selected product moves along the path toward the product retrieval location. Since the embodiment of the invention illustrated inFIGS. 6-8is generally similar to the embodiment of the invention illustrated inFIGS. 1-4, similar numerals will be utilize to designate similar components, the suffix letter “a” being associated with the numerals ofFIGS. 6-8in order to avoid confusion.

A vending machine10ahas a plurality of product dispensing devices24awhich are disposed in a housing, corresponding to the housing12ofFIG. 1. The product dispensing devices24a(FIG. 6) are operable to dispense a product28a(FIG. 7) selected by a customer. In response to actuation of a selector switch keyboard84a(FIG. 6) on a control panel70aby a customer, a selected product28ais moved from a product dispensing location54ain one of the product dispensing devices24a. As the helical conveyor elements42aand44a(FIG. 7) are rotated to dispense the selected product28afrom the dispensing location54a, a next succeeding product28ais moved to the dispensing location54a.

The selected product28amoves downward away from its product dispensing device24aalong a path disposed between the trays48aof products and a door, corresponding to the door16(FIG. 1), toward the product retrieval location60a(FIG. 7). As the selected product is dropping downward along the path toward the product retrieval location60a, the selected product20amoves into an area180of interest in the manner illustrated schematically inFIG. 8. The area180of interest is disposed below the product dispensing devices24aand is disposed above the product retrieval location60a. The area180of interest extends between opposite sides of the vending machine10.

In accordance with one of the features of this embodiment of the invention, when the selected product28ais moving from a product dispensing device24ato and through the area180of interest, one or more imaging devices110aobtain images of the area of interest. These images are transmitted from the imaging devices110ato the computer114a(FIG. 6). The images are stored in an image data base184which forms part of the data base120a. By using the comparator116ato compare each of the images in turn with an image in the data base184, the computer114acan determine when a selected product moves into the area180of interest. When a product has moved into the area180of interest, the computer114aprovides an output which indicates that the selected product has been dispensed.

When the vending machine10a(FIG. 6) has been restocked, that is, filled with products to be sold in the manner described in conjunction with the embodiment of the invention illustrated inFIGS. 1-4, the door of the vending machine is moved from an open position to a closed position. As the door is closed, a switch148a(FIG. 6) is actuated. Actuation of the switch148aindicates to the computer114athat the door has been closed and restocking of the vending machine10acompleted.

When the door closes, the computer114ainitiates operation of the imaging devices100ato obtain images of the products at the dispensing locations54a(FIG. 7) in all of the product dispensing devices24a(FIGS. 6 and 7). The imaging devices100ahave the same construction and mode of operation as the imaging devices100of the embodiments illustrated inFIGS. 3 and 4. The imaging devices100aconvert the visual (optical) images of the products28a(FIG. 7) at the product dispensing location54ain the product dispensing devices24ato electrical signals. These electrical signals are representative of the images of the products28a.

The electrical signals are transmitted from the imaging devices100ato the computer114a(FIG. 6). The computer114ainitiates comparison of features of images represented by the electrical signals with data in the data base120a. This comparison enables the computer114ato determine the identity of each of the products28aat each of the product dispensing locations54ain the product dispensing devices24a.

To identify a product28aat the dispensing location54a, the aspect ratio of the image of the product to be identified is compared to the aspect ratios in the aspect ratio data base126a. The image of the product28ato be identified is compared to the color histograms in the color histogram data base130a. The scale invariant features of the image are compared to the scale invariant feature data base132a.

Once the identity of each of the products28aat the product dispensing locations54ais determined, the price of each of product is determined from the product price database122a. If the price display36afor a particular product is not in agreement with the product price for the product which was identified as being present at the product dispensing location54a, the product price display36ais changed to indicate the correct product price.

After the vending machine10ahas been initialized identifying the next product28ato be dispensed from each of the product dispensing locations54a, the vending machine10ais ready to serve customers. When a customer approaches a vending machine10a, the products28aat the product dispensing locations54ain the product dispensing devices24aare illuminated by a cabinet light assembly, corresponding to the cabinet light assembly152ofFIG. 3. The customer views the products28a(FIG. 7) and the price display36through a transparent window in the door of the vending machine10a.

After a customer has selected a particular product28a, he inserts money to pay for the product into the control panel70a(FIG. 6). Paper money is inserted at the bill validation insert74a, coins are inserted at the coin insert76a. A location may be provided for insertion for a credit/debit card. The customer is informed as to the amount of money which he has deposited into the vending machine by indicia at the credit display window82aon the control panel70a.

Once the customer has deposited a requisite amount of money into the vending machine10a, the customer manually actuates the selector switch keyboard84aon the control panel70a. The customer actuates keys on the selector switch keyboard to enter indicia indicative of the indicia32aindicating the location of the selected product dispensing device24a. The location of the product dispensing device24aselected by a customer is transmitted from the selector switch keyboard84ato the computer114a. At this time, the display88amay set forth indicia indicative characteristics of the selected product.

Once the keyboard84ahas been actuated to enter indicia corresponding to the indicia32aindicating the location of the selected product24a, the computer114aeffects operation of one or more motors156a(FIG. 6) in the product dispensing device24aat the selected product location indicated by the indicia32aentered into the keyboard84aof the control panel70a. The motor156aeffects rotation of the helical conveyor elements42aand44ain the selected product dispensing device24a. It should be understood that the product dispensing device24amay have a different construction if desired.

Rotation of the helical conveyor elements42aand44aby a motor156a(FIG. 6) moves the selected product28aat the selected product dispensing location54aoff of the tray48a(FIG. 7). The selected product28athen drops downward along a vertical path extending from the product dispensing device24ato the product retrieval location60a. At the same time, rotation of the helical conveyor elements42aand44aadvance the next succeeding product28afrom a storage location52ato the product dispensing location54a. Similarly, other products28adisposed in storage locations52ain the selected product dispensing device24aare advanced toward the product dispensing location54aby rotation of the helical conveyor elements42aand44a.

As the selected product28afalls downward along the path toward the product retrieval location60a, the imaging devices110aare operated to obtain images of the area180of interest (FIG. 7). As this occurs, the selected product moves into the area180of interest. The imaging device110a(FIG. 6) is operated to obtain a visual image of the dispensed product. The visual image of the dispensed product28ain the area180of interest is similar to the image illustrated schematically inFIG. 8. The imaging device110has the same construction and mode of operation as the imaging device110of the embodiment ofFIG. 4. The imaging device110amay be a video device.

The visual (optical) images obtained by operating the imaging device110awhile the selected product28amoves toward and is the area180of interest compared with an image in the image database184. The image in the image database184was taken without a product28ain the area180of interest. The image in the data base184may be obtained before or during movement of the selected product28atoward the area of interest. The comparator116acompares the image of the area180of interest taken prior to movement of a product28ainto the area of interest (FIG. 7) with the image of the area of interest taken with the selected product28ain the area of interest (FIG. 8).

When a comparison of the two images indicates that the selected product28ahas moved to the area180of interest, in the manner illustrated schematically inFIG. 8, a signal is transmitted from the comparator116ato the computer114aindicating that the selected product has been dispensed. The computer114athen transmits a signal to the control panel70ato change the credit display window82aby deducting the cost of the dispensed product28afrom the amount of credit indicated at the credit display window. At the same time, the display88ais changed to eliminate the display of the ingredients or other characteristics of the selected product28a. At this time, the display88amay set forth an advertisement for one or more of the products28ain the vending machine10aor may set forth a special price offer for one or more of the products28ain the vending machine10a.

If desired, the image of the selected product28aat the area180of interest, that is, the image illustrated schematically inFIG. 8, may be compared to data in the aspect ratio data base126a, color histogram data base130aand/or scale invariant feature data base132ain an attempt to identify the selected product28a. Of course, the selected product28awill already have been identified with images obtained with the imaging devices100ain the manner described in connection with the embodiment of the invention illustrated inFIGS. 1-4. It is contemplated that the imaging devices100a, which image, products28aat the dispensing location54a, may be eliminated. If this is done, an image of the selected product28awill be obtained only at the area180of interest. An attempt may be made to identify the selected product28afrom the image of the area180of interest (FIG. 8).

If the imaging devices100aare eliminated, it is contemplated that the aspect ratio data base126a, color histogram data base130a, scale invariant feature data base132aand product priced data base122amay be eliminated. If this is done, the data base120would contain only the image data base184. Although it is believed that some vending machines may be constructed with only the imaging devices110ato determine when a selected product28ahas been dispensed, it is contemplated that other vending machines will be constructed with both the imaging devices100aand the imaging devices110a.

To facilitate imaging of a selected product28ain the area180of interest, a stripe188extends across the area of interest. The stripe188is a long narrow section which differs in appearance from adjoining areas in the vending machine10a. The stripe188may have a uniform color or may have a plurality of different colors. The stripe188may be formed of a light reflective material. If desired, sources of light may be included in the stripe188.

The horizontal stripe188extends from the left (as viewed inFIG. 8) edge of the area180of interest to the right edge of the area of interest. The area180of interest is disposed below all of the product dispensing devices24ain the vending machine10aand is disposed above a shelf192at the product retrieval location60a(FIGS. 7 and 8). The area180of interest extends from an inner side surface of a left wall of a housing for the vending machine10ato an inner side surface of a right wall of the housing for the vending machine.

The stripe188extends approximately through the center of the area180of interest. Therefore, the imaging device or devices110acan obtain an image of a selected product28aas it enters and/or leaves the area180of interest. Thus, the imaging device110amay obtain an image of a selected product28aas a lower portion of the selected product moves into the area180of interest. In addition, the imaging device110amay obtain an image of the selected product28aas an upper portion of the selected product moves out of the area180of interest. The imaging device or devices110amay obtain an image of a selected product at any point along its path of movement through the area180of interest. If desired, the stripe188may be omitted.

As is illustrated schematically inFIG. 8, the path of movement of a selected product28athrough the area180of interest is disposed between the stripe188and the imaging device or devices110a. Therefore, the imaging devices110aobtain an image of the product28awith the stripe188as background for the selected product. This facilitates determining when the selected product28ais in an image transmitted from the imaging device or devices110ato the computer114aand compared with an image in the database184by the comparator116a.

The image or images in the data base120aare obtained before the selected product has moved into the area180of interest. Therefore, the selected product28awill not be shown in an image in the image database184. Therefore, a comparison of the image obtained as a selected product28amoves through the area180of interest with an image in the image data base184will result in the controls106asensing at least a portion of the selected product28ain the area180of interest. This comparison is facilitated by having the stripe188extend across the entire width of the area180of interest to provide a contrasting background against which the selected product28ais imaged (FIG. 8).

The illustrated stripe188has alternating light areas196(FIG. 8) and dark areas198. The alternating light and dark areas196and198provide a contrasting background against which a selected product28acan be viewed in an image obtained by an imaging device110a. However, if desired, the stripe188may be formed with a continuous light area196or a continuous dark area198throughout the length of the stripe.

In the illustrated embodiment of the invention, the stripe188is formed by a strip of tape which extends across the area180of interest. It is contemplated that the stripe188may be formed in a different manner if desired. For example, a light area196of the stripe may be formed by light emitting diodes with an associated lens. The dark areas198may be formed by paint on a structural component of the vending machine10a. As was previously mentioned, the stripe188may be omitted if desired.

In the unlikely event that the imaging device or devices110a(FIG. 6) do not obtain an image of a selected product28aat the area180of interest (FIG. 8), the computer114areceives an indication of malfunctioning of the selected product dispensing device24a. The computer114athen effects operation of the motor156aassociated with the selected product dispensing device24awith a jogging or intermittent operation in a further effort to dispense the selected product28a. If this intermittent operation of the motor156ais successful, the intermittent or jogging operation of the motor156ais interrupted when the imaging device or devices110aare able to obtain a visual image of the selected product28aas the selected product moves through the area180of interest.

If the intermittent or jogging operation of the motor156ais ineffective to cause the selected product dispensing device24ato dispense the selected product28a, the computer114achanges the display window88ato indicate to the customer that another selection is to be made. The computer114agives the customer credit for money that has already been deposited in the vending machine10aand allows the customer to make a selection of a product28aof equal or lesser cost. Of course, if a product of lesser cost is selected, the computer114aeffects operation of the vending machine10ato refund the excess amount of money which the customer deposited. Alternatively, the computer114acould immediately give the customer a refund if a selected product28ais not dispensed.

The computer114aperiodically activates the transmitter136a(FIG. 6) to transmit a signal138ato a base or remote location. The signal138aindicates the identity of the products which have been dispensed and indicates the prices of the products. This enables personnel at the base or remote location to determine how much money has been deposited in the vending machine10aand to determine what products need to be brought to the vending machine in order to restock the vending machine. The transmitter136amay be of either a radio or telephone type. Of course, other types of transmitters may be utilized if desired. If desired, the computer114acould activate the transmitter136ato transmit data in response to a signal from a base station.

One or more imaging devices110amay be utilized to obtain visual images of the area180of interest. For example, the field of view of a single imaging device110amay be large enough to include the entire area180of interest. This single imaging device110amay be mounted on the door of the vending machine10ain the manner previously explained in conjunction with the embodiment of the invention illustrated inFIGS. 1-4. Alternatively, the single imaging device110amay be mounted on the housing or other component of the vending machine10a. For example, the imaging device110amay be mounted on the inside of an upper or top wall or panel of a housing, corresponding to the housing12ofFIG. 1.

It is contemplated that a plurality of imaging devices110amay be provided to obtain an image of the selected product28ain the area180of interest. For example, a first imaging device110amay be positioned so as to obtain an image of a central portion of the area of interest. A second imaging device110amay be mounted so as to obtain a view of the left portion of the area of interest, including a small portion of the central portion of the area of interest. In addition, a third imaging device110amay be provided to obtain a visual image of a right portion of the area180of interest and a portion of the central portion of the area of interest. It is contemplated that any desired number of imaging devices may be utilized to obtain images which are compared to images in the image data base184.

The comparator116acompares an image or images taken by one or more imaging devices110ato detect the vending of a selected product28a. Thus, the imaging devices110atransmit images of the area180of interest to the controls106aas a selected product28amoves downward toward the product retrieval location60aand before the selected product moves into the area of interest. This will result in the images of the area180of interest being transmitted to the controls106a. These images will have the composition illustrated schematically inFIG. 7.

Each image is compared to the immediately preceding image to determine whether or not the selected product28ahas moved to the area180of interest. As long as the image is sent from the imaging devices110ato the computer114aare taken before the selected product28aarrives at the area180of interest, the images will have the composition illustrated schematically inFIG. 7. A comparison by the comparator116aof the images having the same composition will indicate to the computer114athat the selected product28ahas not moved downward along its path toward the product retrieval location60ato the level of the area180of interest. The area180of interest is at a level which is lower than the level of all of the product dispensing devices24ain the vending machine10a.

When the selected product28ahas moved downward to the area180of interest, in the manner illustrated schematically inFIG. 8, the selected product28ais disposed between the imaging device or devices110aand the stripe188. Therefore, at this time, when an image of the area180of interest is obtained by operation of an imaging device110a, the selected product28awill block the view of an imaging device110aof a portion of the stripe188. This results in the stripe being interrupted in the image obtained with the imaging device110a. When the image obtained with an imaging device110aof the area180of interest with the selected product28ain the area of interest (as shown inFIG. 8), the image will differ from the immediately preceding image obtained by the imaging device110a.

As the selected product28amoves into the area180of interest, the lower portion of the product moves into the area of interest. If the image of the selected product is obtained at this time, the comparator116aand computer114awill determine that the upper perimeter portion of the most recent image is different than the upper perimeter portion of the immediately preceding image. Therefore, the computer116awill provide an output which indicates that a selected product has been dispensed.

When the image obtained by an imaging device110aof an area180of interest with the selected product28ain the area of interest is compared with an immediately preceding image in which the selected product is not in the area of interest, the difference between the two images will result in the comparator116atransmitting a signal to the computer114aindicating that the selected product28ahas moved into the area180of interest and will fall downward onto the shelf192. This results in the computer114asending a signal to the control panel70aindicating that the selected product has been vended. At this time, the credit display82awill be modified to indicate a reduction in the customer's credit as a result of the successful vending of the selected product28a. Of course, if for some unforeseen reason there is not a successful vending of a selected product28aby the vending machine10a, the images transmitted from the image device or devices110ato the computer114awill all be the same and the comparator116awill not provide an output signal to the computer114aindicating that a product has been successfully vended.

In the foregoing description, each image of the area180of interest obtained by an imaging device110ais compared with the immediately preceding image of the area of interest. However, it is contemplated that the comparator116amay compare an image transmitted from an imaging device with any one of the images taken before the image presently being transmitted from the imaging device to the computer114a. For example, an image obtained by the imaging device110amay be compared with each of the preceding five images transmitted from the imaging device110ato the computer114a. Alternatively, the image obtained by operation of an imaging device110amay be compared only with the fifth preceding image in a series of preceding images.

Since the image of the area180of interest remains substantially constant until a selected product28aenters the area of interest, it is contemplated that all of the images obtained from the imaging devices110amay be compared with the same image of the area180of interest. For example, a base or reference image of the area180of interest may be stored in the image data base184. This base or reference image will be compared with each of the images obtained by the imaging devices110a. The comparator116awill detect a change in the images obtained by operation of the imaging devices from the base or reference image only when a selected product28ahas moved into the area180of interest. The base or reference image may be provided in the data base184before the vending machine10ais moved to a location where it is to vend products28a.

If a plurality of imaging devices110aare utilized to obtain an image of a product as the product moves through the area180of interest, an image from each imaging device may be compared with a separate image in the data base. Thus, an image of the area180of interest obtained with a first one of the imaging devices110awould be compared with an image in the data base184of the area180of interest obtained with the first one of the imaging devices110a. Similarly, an image of the area of interest obtained with a second one of the imaging devices110awould be compared with an image in the data base184of the area of interest obtained with the second one of the imaging devices110a. Alternatively, images of the area180of interest obtained with all of the imaging devices110amay be compared with the same image in the data base184.

The imaging devices110aare utilized to deter theft by being operated before and/or after dispensing of a selected product28a. When the imaging devices110aare operated before and/or after dispensing of a product28a, a comparison of images obtained by the imaging devices should indicate that the images are all the same. If the comparison of images shows a change in one or more of the images, this would indicate movement of a foreign article into the area of interest. Such a foreign article may be moved into the area of interest during an attempt to steal products28afrom the vending machine10a. In response to the change in the images obtained with movement of a foreign article into the area180of interest, the vending machine10amay shut down and/or a base location notified with the transmitter136a. If desired, an alarm may sound and/or lights may flash.

Conclusion

The present invention provides a vending machine10having a plurality of product dispensing devices24. Each of the product dispensing devices24holds a next product28to be dispensed from the dispensing device and a plurality of products which are located at product storage locations52in the product dispensing device. The products at the storage locations are sequentially moved to the product dispensing location.

When a customer selects a product28, the product is moved from one of the product dispensing locations54to a product retrieval location60where the customer has access to the selected product. The selected product moves from one of the product dispensing devices24along a path which extends to the product retrieval location. In accordance with one of the features of the present invention, an image of the selected product28is obtained as the selected product moves along the path toward the product retrieval location60.

As the selected product28moves along the path toward the product retrieval location, a plurality of images of a selected portion180of the path are sequentially obtained and transmitted to a data base120. Each of the images (FIG. 8) is compared to an image (FIG. 7) in the data base120to determine when a product28has moved into the image. In response to movement from the product28into the image, controls106in the vending machine10determine that a product has moved to the product retrieval location.

The present invention has a number of different features. These features may be utilized together as disclosed herein. These features may be utilized separately and/or in various combinations with each other or the prior art.