Patent application EP17162222A (EP), filed 2017-03-22
Publication number: EP3229195A1
Title: IMAGE PROCESSING DEVICE
Abstract: According to one embodiment, an image processing device includes a region cutout unit, a mask generation unit, a commodity identification unit, and a discount processing unit. The region cutout unit cuts out a partial image corresponding to commodity from an input image. The mask generation unit generates discount information on the basis of a first pattern image and generates a first mask pattern on the basis of a position where the first pattern image is detected, in a case where the first pattern image is detected in the partial image. The commodity identification unit specifies commodity corresponding to the partial image by matching a mask image which is masked by the first mask pattern with respect to the partial image, with a dictionary-registered image corresponding to each of a plurality of pieces of commodity, and acquires commodity information corresponding to the partial image.
IPC codes: G06Q  10/    06            A I
G06Q  30/    02            A I
Claims: number: 1
text: An image processing device comprising:
number: 2
text: The device according to claim 1, further comprising:
number: 3
text: The device according to claim 2,
wherein the mask generation unit generates a third mask pattern on the basis of a position where a third pattern image is detected, in a case where the first pattern image is not detected in the partial image and the third pattern image is detected, and
wherein, in a case where the second pattern image is not detected in the partial image, the commodity identification unit specifies commodity corresponding to the partial image by matching a mask image which is masked by the third mask pattern with respect to the partial image with a dictionary-registered image corresponding to each of a plurality of pieces of commodity, and acquires commodity information corresponding to the partial image.
number: 4
text: The device according to any one of claims 1 to 3,
wherein the region cutout unit cuts out a plurality of partial images corresponding to each of a plurality of pieces of commodity from the input image, and
wherein the discount processing unit performs discount processing with respect to the commodity information corresponding to a partial image in which the first pattern image is detected by using the mask generation unit.
number: 5
text: The device according to any one of claims 1 to 4, wherein the commodity identification unit includes,
a first masking unit that generates a mask partial image by converting a part of the partial image into a constant pixel value, based on the first mask pattern;
a local feature point extraction unit that extracts local feature point information with respect to the mask partial image;
a feature point matching unit that collates the local feature point information and local feature point information of commodity image which is previously registered in a dictionary, and outputs a projection conversion matrix which represents a relative position relationship between both, and commodity information of candidate commodity with respect to content of the partial image, based on a correspondence state of a local feature point between both;
a projection conversion unit that reads a dictionary-registered image corresponding to commodity information of the candidate commodity and generates a projection registration image which is obtained by performing projection conversion of the dictionary-registered image on the basis of the projection conversion matrix;
a second masking unit that generates a mask registration image by converting a part of the projection registration image into a constant pixel value, based on the first mask pattern; and
a detailed matching unit that calculates degree of similarity between the mask partial image and the mask registration image, and outputs commodity information corresponding to the partial image, based on the degree of similarity and a predetermined determination threshold.
number: 6
text: An image processing system comprising:
number: 7
text: The system according to claim 6, further comprising:
number: 8
text: The system according to claim 7,
wherein the mask generation means generates a third mask pattern on the basis of a position where a third pattern image is detected, in a case where the first pattern image is not detected in the partial image and the third pattern image is detected, and
wherein, in a case where the second pattern image is not detected in the partial image, the commodity identification means specifies commodity corresponding to the partial image by matching a mask image which is masked by the third mask pattern with respect to the partial image with a dictionary-registered image corresponding to each of a plurality of pieces of commodity, and acquires commodity information corresponding to the partial image.
number: 9
text: The system according to any one of claims 6 to 8,
wherein the region cutout means cuts out a plurality of partial images corresponding to each of a plurality of pieces of commodity from the input image, and
wherein the discount processing means performs discount processing with respect to the commodity information corresponding to a partial image in which the first pattern image is detected by using the mask generation means.
number: 10
text: The system according to any one of claims 6 to 9, wherein the commodity identification means includes,
a first masking means that generates a mask partial image by converting a part of the partial image into a constant pixel value, based on the first mask pattern;
a local feature point extraction means that extracts local feature point information with respect to the mask partial image;
a feature point matching means that collates the local feature point information and local feature point information of commodity image which is previously registered in a dictionary, and outputs a projection conversion matrix which represents a relative position relationship between both, and commodity information of candidate commodity with respect to content of the partial image, based on a correspondence state of a local feature point between both;
a projection conversion means that reads a dictionary-registered image corresponding to commodity information of the candidate commodity and generates a projection registration image which is obtained by performing projection conversion of the dictionary-registered image on the basis of the projection conversion matrix;
a second masking means that generates a mask registration image by converting a part of the projection registration image into a constant pixel value, based on the first mask pattern; and
a detailed matching means that calculates degree of similarity between the mask partial image and the mask registration image, and outputs commodity information corresponding to the partial image, based on the degree of similarity and a predetermined determination threshold.
number: 11
text: A method for performing an image processing, comprising the steps of:
number: 12
text: The method according to claim 11, further comprising the steps of:
number: 13
text: The method according to claim 12, further comprising the steps of:
number: 14
text: The method according to any one of claims 11 to 13, further comprising the steps of:
number: 15
text: The method according to any one of claims 11 to 14, further comprising the steps of:
Office action: search_report, dated 2017-10-11
Prior art cited: ref_id: US2013243307A1
ref_type: patent
severity: background
ref_id: US2011123114A1
ref_type: patent
severity: background
ref_id: US2011142298A1
ref_type: patent
severity: background
ref_id: US2011123114
ref_type: patent
severity: background
ref_id: US2013243307
ref_type: patent
severity: background
Final disposition: pending (2017-10-11)