GOODS INFORMATION COLLECTION DEVICE

A goods information collection device includes: a box; a carrier plate disposed on an inner bottom surface of the box for placing goods and an image capturing device. The image capturing device is configured to collect at least one image of the goods. The goods information collection device further includes a storage for storing the image of the goods and a data processing device connected to the image capturing device and the storage.

FIELD

The disclosure relates to a technical field used in the retail industry, particularly, a goods information collection device.

BACKGROUND

In the unmanned supermarket project, computer vision technology can identify the types of goods based on the external visual effects of the goods. In the application of computer vision technology, the computer needs to collect a large number of photos of each type of goods in advance, and use a large number of photos as samples to build a goods identification model to acquire the appearance information of each product, such as shape, pattern, color, size, etc. In theory, the more photos entered into the database during modeling, the higher the accuracy of goods identification after modeling. Generally speaking, each goods needs thousands or even tens of thousands photos taken from different angles and/or different directions before entering the unmanned supermarket for sale. If one uses a traditional camera or camera to collect photos, it is time-consuming and laborious, and the speed is very slow. The photographing process of each goods generally lasts 30-60 minutes, and the error rate is high.

Before the goods are sold in the unmanned supermarket, besides the image data (e.g., photos), the computer also collects the weight, model, product number and other information of the goods. There are many types of data to be collected, the collection process is complicated, the efficiency is low, and the workload is large.

SUMMARY

According to a first aspect of the disclosure, there is provided a goods information collection device, including a box; a carrier plate disposed on an inner bottom surface of the box for placing goods; an image capturing device configured to collect at least one image of the goods; a storage for storing the image of the goods; and a data processing device connected to the image capturing device and the storage.

DETAILED DESCRIPTION

Examples will be described in detail herein with the illustrations thereof expressed in the drawings. The implementations described in the following examples do not represent all implementations consistent with the present disclosure. On the contrary, they are examples of an apparatus and a method consistent with some aspects of the present disclosure. In the drawings, elements having the same structure are denoted by the same reference numerals, and elements having similar structures or functions are denoted by similar reference numerals.

In the drawings, elements having the same structure are denoted by the same reference numerals, and elements having similar structures or functions are denoted by similar reference numerals. The directional terms, such as upper, lower, front, rear, left, right, inner, outer, upper surface, lower surface, side surface, top, bottom, front, rear, end, etc., used in the disclosure are only used for explanation and illustration, and are not intended to limit the scope of the disclosure.

When an element is referred to as being “on” another element, it can be directly on the other element; there may also be an intermediate element, the element being disposed on the intermediate element and the intermediate element being disposed on the other element. When an element is referred to as being “mounted to” or “connected to” another element, it is to be understood that the element is directly “mounted to” or “connected to” the other element or that the element is indirectly “mounted to” or “connected to” the other element through an intermediate element.

The example of the disclosure relates to a goods information collection device. Referring toFIG. 1, the goods information collection device includes a box1, which is a closed rectangular parallelepiped box surrounded by six box plates101. Among them, any box plate101is detachably connected to other four box plates. In other examples, the box1may also be a cube or a cylinder.

Referring toFIG. 2, the box plate101includes a plate/board body1011. A protruding buckle1012and a bayonet1013are provided at the edge of the plate/board body1011, and the bayonet1013penetrates the plate/board body1011at the edge. The buckle of any one of the box plates can be detachably snapped into the bayonet of another box plate, so that the box1is easy to disassemble and convenient to carry or transport.

The box1may also include a brown transparent window102embedded in a box plate101of the box1, so that the user can observe the working state of the box from the outside of the box1.

In other examples, a certain box plate of the box1may further include a box door (not shown in the figure), and the user can put goods into the box1or take it out of the box1through the box door without removing the box plate.

Referring toFIGS. 3 to 4, in this example, the box plate located on the bottom surface of the rectangular parallelepiped box1is the box base plate103. The inner bottom surface of the box1, that is, the upper surface of the box base plate103is provided with a first rotating device21. The first rotating device21includes a first rotating wheel211, a first motor212and a first circular conveyor belt213. The first rotating wheel211is rotatably mounted to the inner bottom surface of the box through a first bearing214. The first motor212is fixed to the inner bottom surface of the box. The first motor212includes a rotor (not shown in figures), and the central axis of the rotor is parallel to the central axis of the first rotating wheel211. The first circular conveyor belt213is tightly sleeved on the outer side wall of the first rotating wheel211and the rotor, and the inner side wall of the first circular conveyor belt213is tangent to the outer side wall of the first rotating wheel211and the outer side wall of the rotor.

Referring toFIGS. 3 to 5, the example also includes a carrier plate2which is horizontally arranged on the top of the first rotating device21for placing goods. When the first motor212is started, the rotor of the first motor212drives the first circular conveyor belt213to rotate clockwise, and under the traction of the first circular conveyor belt213, the first rotating wheel211also rotates clockwise. At this time, the first bearing214of the first rotating wheel211drives the first carrier plate2to rotate, thereby causing the goods on the first carrier plate2to rotate.

Referring toFIG. 3, a light source3is provided on the inner top surface of the box1to illuminate the inside of box1. The light source3can be an LED lamp, a ball lamp, an incandescent lamp, etc., which makes the light of the box uniform.

Referring toFIG. 3, an image capturing device, which may also be referred to as an image capturing unit, is located in the box1, and is used to collect at least one image of the goods. The image can be either a picture or a photo, or a video. The image capturing unit includes at least one camera unit. In this example, the image capturing unit includes a first camera301and a second camera302. The first camera301and the second camera302may be referred to as the first camera unit301and the second camera unit302, respectively.

The first camera unit301is arranged on the inner side wall of the box1. The first camera unit301includes a first lens and an imaging plate (not shown in figures). The first lens faces the goods on the carrier plate2. The central axis of the first lens is perpendicular to the imaging plate, and the goods are photographed after receiving instructions. In some arrangements, the height of the first lens is the same as the height of the middle part of the goods placed on the carrier plate2, and the angle between the central axis of the first lens and the central axis of the carrier plate2is 90 degrees. When the carrier plate2drives the goods to rotate, the first camera unit301can capture image data of goods from various angles and on multiple sides in the horizontal direction, the image data including pictures and/or videos.

Referring toFIG. 4, the second camera unit302is fixed to the top surface inside the box1, and it is close to a corner where the top and two sides meet. The second camera unit302includes a second lens which faces the goods on the carrier plate2. The angle between the central axis of the second lens and the central axis of the object carrier2is 20 to 70 degrees, and the second lens can be set to have an adjustable angle, so that the second lens is always aimed at the goods on the carrier plate2during the shooting process, and the goods are photographed after receiving the instruction. When the carrier plate2drives the goods to rotate, the second camera unit302can capture images of the goods from the above and capture image data of goods from various angles and on multiple sides, the image data including pictures and/or videos.

Referring toFIGS. 3 to 4, a cover plate401is provided at the bottom of the box1, which is parallel to the box base plate103. The cover plate401and the box base plate103enclose an electrical warehouse4for placing the first rotating device21, a printed circuit board402and the power supply device (not shown in figures). The internal height of electrical warehouse4is the same as or similar to the height of the carrier plate2, which will not affect the photographing process of the goods on the carrier plate2by the first camera unit301. For ease to install, the cover plate401and the box base plate103can be divided into two parts, and the electrical warehouse4can also be divided into two parts, namely a first warehouse41and a second warehouse42. The first warehouse41is used to place the first rotating device21, and the second warehouse42is used to place the printed circuit board402and the power supply device (not shown in figures). The printed circuit board402is connected to a data processing unit through at least one data line. The power supply device can be a power adapter coupled to an external alternating current, or a battery pack, which provides power to the data processing unit and the printed circuit board (PCB).

During use of this example, the user mounts the box plates101, places the goods to be photographed on the carrier plate2, and starts photographing the goods. When the image capture device receives a photographing instruction, since the image capture device has a self-aligning function, the first lens and the second lens face the carrier plate2respectively, and the motor212of the first rotating device21is activated, so that the carrier plate2drives the goods to slowly rotate. The first camera unit301and the second camera unit302obtain pictures or videos of the goods at a speed of 10-60 frames per second, preferably a speed of 20 or 24 or 25 or 30 frames per second, and obtain thousands or tens of thousands of images of the side or top of the goods at different angles, in order to serve as samples for building a computer vision model.

The goods applicable to this example are generally standard goods. The appearance and size of the same type of goods are the same or similar. Only one product in the same type of goods needs to be photographed to complete the picture sampling of that type of goods. The first rotating device21must drive the goods to rotate for at least one revolution, and so that the first camera unit301and the second camera unit302can obtain images of the goods from various angles and directions. It takes 3 to 90 seconds for the first rotating device21to rotate one revolution at a uniform speed. If it takes 60 seconds for the first rotating device21to rotate one revolution at a uniform speed, the first camera unit301and the second camera unit302obtain pictures of goods at a rate of 30 frames per second, and the goods information collection device can collect 1800 pictures of goods per minute.

The goods information collection device also including a storage5and a data processing device6. The storage5and the data processing device6may also be referred to as the storage unit5and the data processing unit6. In this example, a Raspberry Pi12is used, with an SD card or MicroSD card as the storage unit5, and an ARM processor as the data processing unit6. Referring toFIG. 3, in this example, the Raspberry Pi12is fixed to the side wall of box1, and is installed in the same housing as the first camera unit301. Various interfaces (such as network cable interface, USB interface) of Raspberry Pi12are located on the side wall of the box1, and are exposed outside the box. In other examples, the Raspberry Pi12also can be installed in electrical warehouse4, and the first camera unit301is fixedly or movably installed on the side wall of the box1.

The first camera unit301and the second camera unit302are electrically coupled to the data processing unit6, and the photos taken are transmitted to the Raspberry Pi12in real time and stored in the storage unit5. When necessary, the data processing unit6may carry out a preliminary screening and delete lower-resolution photos.

The storage unit5of the Raspberry Pi12stores therein a large number of computer-executable instructions for executing a method for determining the size of a type of goods, and the size of the goods can be calculated according to the size of the image of the goods. The method for determining the size of the goods includes the following steps: step S1) distance parameter input step, recording the horizontal distance between the first lens and the front end of the goods, and recording the distance between the first lens and the imaging plate; step S2) goods image acquisition step, obtaining the image of the goods formed on the imaging plate; step S3) image size acquisition step, obtaining the size of the image of the goods; step S4) goods size calculation step, calculating the size of the goods according to the size of the goods image, the distance between the first lens and the front end of the goods, and the distance between the first lens and the imaging plate.

The data processing unit6of the Raspberry Pi12includes a plurality of execution units, which are respectively used to execute each computer executable instruction, and each instruction executes a step of the method for determining the size of the goods.

Referring toFIG. 6, the execution unit of the data processing unit6includes a distance parameter input unit or distance parameter input device601, a goods image acquisition unit or goods image acquisition device602, an image size acquisition unit or image size acquisition device603, and a goods size calculation unit or goods size calculator604. The data processing unit6can calculate the size of the product according to the size of the image of the goods, and obtain size information such as the length, width, and height of the goods.

The distance parameter input unit601is used to input the horizontal distance between the first lens and the front end of the goods and the distance between the first lens and the imaging plate. The goods image acquisition unit602is used for acquiring the goods image formed on the imaging plate of the goods. The image size acquisition unit603is used to obtain the size of the image of the goods. The goods size calculation unit604is configured to calculate the size of the goods according to the size of the goods image, the distance between the first lens and the front end of the goods, and the distance between the first lens and the imaging plate.

The carrier plate2is provided with a mark. When placing the goods, the user can place the goods on the mark of the carrier plate2so that the front end of the goods corresponds to the mark. The center point of the mark is on the same horizontal plane as the center point of the first lens, that is the horizontal distance between the first lens and the front end of the goods, which can be pre-measured or preset. The distance between the first lens and the imaging plate is a camera parameter of the first camera unit301, which is known. The horizontal distance between the first lens and the front end of the goods, and the distance between the first lens and the imaging plate can be set during the debugging of the device and input into the Raspberry Pi.

When the goods are rotated horizontally by a certain angle, the first camera unit301can take photos of the goods at different angles, and the goods size calculation unit604can calculate the size of the goods according to the principle of optical imaging, including the length, width and height of the goods. Referring toFIG. 7, in this example, if the distance from the first lens to the front end of the goods is D, the focal length of the first lens is f, and the imaging height of the goods is h, according to the principle of optical imaging, the true height of the goods is H=h*D/f. Since the goods can be rotated, the goods size calculation unit604can further calculate the length and width of the goods. Referring toFIG. 7, the example also includes a server7, a scanning device8, a display device9, an alarm device10, and a control panel13, which are respectively coupled to the data processing unit6.

The server7is located outside the goods information collection device and is coupled to the data processing unit6in a wired or wireless manner. Due to the limited storage space of the Raspberry Pi12, the images and/or sizes of the goods can also be sent to the server7to generate and update the goods database in the server, and record the image, size and other goods information of the goods. The surface of the goods or its packaging is provided with an identifiable code, such as a barcode, a QR code, etc. The identifiable code stores goods information, including the category, model, product number, serial number, price, and place of origin.

The scanning device8is arranged outside the goods information collection device, and is coupled to the data processing unit6in a wired or wireless manner to scan the code of the product, and then identify the goods information, such as product category, model, and price, etc. The above-mentioned goods information can be transmitted to the server7to further improve the goods information in the product database.

The display device9is arranged outside the goods information collection device, in some arrangements, on the outer side wall of the box1, to display the goods information and/or photographing progress, photographing time and other work information. The alarm device10is a speaker, which is arranged on the outer side wall of the box1or the circuit board of the Raspberry Pi12. After the image information of the goods is collected, the motor212is automatically turned off, and the first camera unit301and the second camera unit302automatically stop taking pictures. The alarm device emits an alarm sound to prompt the user that the information collection of the goods is completed, and prompt the user to take the goods out or collect information on the next goods.

The control panel13is arranged on the outer side wall of the box1for inputting user's control instructions. Both the display device9and the alarm device10can be arranged on the control panel13. The goods information collection device obtains the control instructions input by the user, and it can control the power supply to supply power to or cut off the power from each electrical component, and control the motor212, the first camera unit301, and the second camera unit302of the first rotating device21to start or stop operations.

In the process of using this example, the user first assembles the box1, uses the scanner8to obtain the barcode information of the goods, records the information of the goods, and then sends the goods through the box door into the box and places them on the carrier plate2. The user closes the box door, sets the shooting time (such as two minutes), and starts the first rotating device21to drive the carrier plate2to rotate. The first camera unit301and the second camera unit302collect the image information of the goods at high speed, and then transfer to the server7.

The beneficial effect of this example is to provide a goods information collection device that can quickly take photos when the goods are automatically rotated, and obtain a large number of photos of the same goods from different angles in a short time, so as to provide enough picture samples for building a computer vision model. It effectively saves manpower and material resources, and improves the shooting efficiency of the goods. At the same time, the goods information collection device can also be used to collect other goods information such as the type, model, and price of the goods.

Referring toFIGS. 8 to 11, example 2 provides a goods information collection device, including all the technical solutions of example 1. The difference between the two is that example 2 also includes a weighing device11, which includes a weighing plate1101and weight sensor1102.

The weighing plate1101is a part of the cover plate401and is on the same plane as the carrier plate2. The weighing plate1101is arranged on the inner bottom surface of the box1for placing goods. The lower surface of one end of the weight sensor1102is connected to the inner bottom surface of the box1, that is, the box base plate103, and the upper surface of the other end is connected to the lower surface of the weighing plate1101. The weight sensor1102is coupled to the data processing unit6, and the weight sensor1102measures the weight data of the goods and transmits the weight data to the data processing unit6.

Another difference between the example 2 and example 1 is that, in the example 2, the raspberry pi12is also installed in the electrical warehouse4, and the first camera unit301is fixedly installed on the side wall of the box1.

In the process of using this example, the user first assembles the box, uses the scanning device8to obtain the barcode information of the goods, records the information of the goods, and then sends the goods through the box door into the box and places them on the weighing board. The weight sensor collects the weight data of the goods, and the data processing unit6can record the weight value of each goods according to this, and send it to the server7for storage in the goods database.

Then, the user transfers the goods to the carrier plate2, closes the door, sets the shooting time (such as two minutes), and activates the first rotating device21to drive the carrier plate2to rotate. The first camera unit301and the second camera unit302collect the image information of the goods at high speed and transmit it to the server7.

The beneficial effect of this example is to provide a goods information collection device that in addition to obtaining a large number of photos of the same goods from different angles in a short time, can also obtain goods information such as weight data of the goods.

Referring toFIGS. 12 to 15, this example provides a goods information collection device, which includes all the technical features of example 1, and also includes a translation device14and a lifting device15, which are all arranged on the inner side wall of the box1. In this example, the first camera unit301is installed on the translation device14, and the second camera unit302is installed on the lifting device15; and the lifting device15is arranged on the upper part of an inner side wall of the box1. In other examples, the first camera unit301may also be installed on the lifting device15, and the second camera unit302may be installed on the translation device14; at the same time, the lifting device15is arranged on the upper part of the inner side wall of the box1.

The translation device14includes a first sliding rail141, a first sliding block142and a first telescopic rod143. The first sliding rail141is horizontally arranged on an inner side wall of the box1. The first sliding block142is slidably mounted to the first sliding rail141, and the first sliding block142is connected to the first camera unit301. And one end of the first telescopic rod143is connected to the first sliding block142, and the other end is fixedly connected to one end of the translation device14. When the length of the first telescopic rod143changes, the first sliding block142translates along the first slide rail141, which drives the first camera unit301to move horizontally, so that images of the goods from multiple angles can be collected to obtain more image data.

The lifting device15includes a second sliding rail151, a second sliding block152and a second telescopic rod153. The second sliding rail151is vertically arranged on the upper part of the inner side wall of the box1, the second sliding block152is slidably mounted to the second sliding rail151, and the second sliding block152is connected to the second camera unit302. One end of the second telescopic rod153is connected to the second sliding block152and the other end is fixedly connected to one end of the lifting device15. When the length of the second telescopic rod153changes, the second slider152moves up and down along the second slide rail151, which drives the second camera unit302to move up and down, so that images of the goods from multiple angles can be collected to obtain more image data.

The first telescopic rod143and the second telescopic rod153can be electrically connected to the data processing unit6respectively, and the user can control the telescopic amount of the first telescopic rod143and the second telescopic rod153according to actual needs, and then adjust the lens angles and positions of the first camera unit301and the second camera unit302. These adjustments may occur before the photographing process or during the photographing process.

In another example, the goods information collection device may further include a second lifting device (not shown in figures), which is arranged on the inner side wall of the box1, and the translation device14is liftably mounted to the second lifting device. The first camera unit301is movably mounted to the first sliding block142of the translation device14. The first camera unit301can be installed in the translation device14so that the first camera unit301can move horizontally and/or move up and down, which can take photos of goods from more angles and directions, and collect more image data of the goods.

In other examples, the goods information collection device, besides including all the technical features of example 1, may also include the translation device14or the lifting device15described above, and the translation device14or the lifting device15may be arranged on the inner side wall of the box1.

The beneficial effect of this example is to provide a goods information collection device with the first camera unit and the second camera unit that can move horizontally and/or up and down during the shooting process to obtain a large number of photos of the same goods from more angles in a short time.

Referring to FIGS.16to19, this example provides a goods information collection device, which includes all the technical features of example 1. The difference between the two is that example 4 does not include the first rotating device21, but includes a second rotating device22, which is arranged on the inner top surface of the box1. The second camera unit302is installed to the second rotating device22instead of being installed on the inner side wall of the box1.

The structure of the second rotating device22is similar to the structure of the first rotating device21, and the second rotating device22includes a second rotating wheel221, a second motor222and a second circular conveyor belt223. The second rotating wheel221is rotatably mounted to the inner top surface of the box1through a second bearing224; the second motor222is fixed to the inner top surface of the box1, and the second motor222includes a second rotor (not shown in figures). The central axis of the second rotor is parallel to the central axis of the second rotating wheel221; the second circular conveyor belt223is tightly sleeved on the outer side wall of the second rotating wheel221and the second rotor, and the inner side wall of the second circular conveyor belt223is tangent to the outer side wall of the second rotating wheel221and the outer side wall of the second rotor.

In this example, it also includes a rotating plate225horizontally arranged on the top of the second rotating device22. When the second motor222rotates, the second motor222drives the second circular conveyor belt223to rotate clockwise. Under the traction of the second circular conveyor belt223, the second rotating wheel221also rotates clockwise. At this time, the bearing224of the second rotating wheel221drives the rotating plate225to rotate, so that the second camera unit302connected to the rotating plate225through a bracket226is rotated.

In this example, the carrier plate2and the goods are stationary, and the second rotating device22drives the second camera unit302to rotate on a horizontal plane, so as to photograph the goods on the carrier plate2. It takes 3 to 90 seconds for the second rotating device22to rotate one circle at a uniform speed, and its technical effect is similar to that of example 1, and will not be repeated here.

In other examples, the goods information collection device, besides including all the technical features of example 1, may also include the second rotating device22described above. The second rotating device22is arranged on the inner top surface of the box1, and the second camera unit302is installed to a second rotating device22instead of being installed on the inner side wall of the box1. Under the joint action of the first rotating device21and the second rotating device22, the first camera unit301and the second camera unit302facing the goods on the carrier plate2, rotate relative to the goods, and perform fast shooting at the same time, and a large number of photos of the same goods from more angles can be obtained in a short time.

In the above examples, the first camera unit301and the second camera unit302are ordinary color cameras, which have a low cost, and the shooting speed of the two camera units is 20-30 frames per second. In the process of collecting information, it requires less time and is fast, which can save a lot of manpower and material resources, and can effectively improve the efficiency of goods information collection.

The beneficial effect of this example is to provide a goods information collection device where the relative viewing angle and relative direction between its image capturing unit and the goods can be adjusted during the shooting process, and the goods information collection device can photograph a large number of pictures of the same goods in different angles and different directions in a short time, which greatly improves the shooting efficiency and effectively saves labor and time costs.

The present disclosure provides examples of a goods information collection device, which can solve the technical problems of manual collection of product information in the prior art, such as time-consuming, slow speed, high labor cost, and high error rate

The description of the present disclosure has been presented for purposes of illustration, and is not intended to be exhaustive or limited to the present disclosure. Many modifications, variations, and alternative implementations will be apparent to those of ordinary skill in the art having the benefit of the teachings presented in the foregoing descriptions and the associated drawings.

The examples were chosen and described in order to explain the principles of the disclosure, and to enable others skilled in the art to understand the disclosure for various implementations and to best utilize the underlying principles and various implementations with various modifications as are suited to the particular use contemplated. Therefore, it is to be understood that the scope of the disclosure is not to be limited to the specific examples of the implementations disclosed and that modifications and other implementations are intended to be included within the scope of the present disclosure.