Source: https://patents.justia.com/patent/20090177628
Timestamp: 2019-09-17 02:25:26
Document Index: 143813857

Matched Legal Cases: ['Application No. 2000', 'art 11', 'art 12', 'art 12', 'art 12', 'art 12', 'art 12', 'art 11', 'art 12', 'art 12', 'art 12', 'art 11', 'art 12', 'art 12', 'art 12', 'art 12', 'art 12', 'art 12', 'art 12', 'art 11', 'art 12', 'art 11', 'art 11', 'art 12', 'art 11', 'art 11', 'art 11', 'art 11', 'art 12', 'art 11', 'art 11', 'art 12', 'art 11', 'art 12', 'art 11', 'art 12', 'art 11', 'art 12', 'art 12', 'art 12', 'art 11', 'art 11', 'art 12', 'art 12', 'art 12', 'art 12', 'art 11', 'art 12', 'art 11', 'art 11', 'art 11', 'art 11', 'art 12', 'art 12', 'art 12', 'art 11', 'art 12', 'art 12', 'art 12', 'art 12', 'art 11', 'art 12', 'art 12', 'art 11', 'art 11', 'art 11', 'art 11', 'art 12', 'art 12', 'art 12', 'art 12', 'art 11', 'art 11', 'art 11', 'art 11', 'art 11', 'art 11', 'art 11', 'art 12', 'art 11', 'art 12']

US Patent Application for SYSTEM, APPARATUS, AND METHOD FOR PROVIDING ILLEGAL USE RESEARCH SERVICE FOR IMAGE DATA, AND SYSTEM, APPARATUS, AND METHOD FOR PROVIDING PROPER USE RESEARCH SERVICE FOR IMAGE DATA Patent Application (Application #20090177628 issued July 9, 2009) - Justia Patents Search
Justia Patents US Patent Application for SYSTEM, APPARATUS, AND METHOD FOR PROVIDING ILLEGAL USE RESEARCH SERVICE FOR IMAGE DATA, AND SYSTEM, APPARATUS, AND METHOD FOR PROVIDING PROPER USE RESEARCH SERVICE FOR IMAGE DATA Patent Application (Application #20090177628)
This Application is a Division of application Ser. No. 10/876,051 filed on Jun. 25, 2004, now U.S. patent Ser. No. ______.
On the other hand, Japanese Laid-open Patent Application No. 2000-215238 discloses a method for detecting an illegal literary work or search for a similar image, in which a feature amount registered beforehand is compared with a feature amount obtained by a search and it is determined whether or not that searched work is an illegal literary work based on that comparison result. In this method, it is determined whether or not an URL (Uniform Resource Locator), a file name, a file size, a calculated hash value, and a like being obtained as the feature amount are identical to information registered to a feature amount DB (DabaBase).
The above objects of the present invention are achieved by a server apparatus for conducting a proper use research of image data permitted to use, the server apparatus including: a research subject registering part registering image data received from the research client as a research subject to a research subject database for each research client; a research condition setting part setting a research condition for research whether or not the image data being registered are properly used by a research subject Web site on a network; a similar image searching part calculating a feature amount of the mage data registered by the research subject registering part, and searching for image data being identical or similar to the image data of the research subject based on the feature amount being calculated and the research condition; and a search result informing part informing a search result by the similar image searching part as a research report to the research client.
The above objects 6f the present invention are achieved by a program product for causing a computer to function as a system for providing a proper use research service for image data, the program product including the codes for: functioning as a server apparatus for conducting a proper use research for researching whether or not image data being permitted to use is properly used; and functioning as a terminal apparatus used by a research client requesting the proper use research, including the codes for connecting to the server apparatus through a network, wherein the functioning as the server apparatus includes the codes for: registering part registering image data received as a research subject from the terminal apparatus and identification information of a Web site managed by a user who received a user permit of the image data for each research client to a research subject database; setting a research condition for researching whether or not the image data being registered is properly used at a research subject Web site registering the identification information; calculating a feature amount of the image data registered by the research subject registering part and searching for image data being identical or similar to the image data being the research subject based on the calculated feature amount and the research condition from the research subject Web site on the network; and informing a search result by the similar image searching part as a research report to the research client using the terminal apparatus.
In order for the user to easily operate the above-described program when the user uses at the display unit 6, the program may include a graphical user interface (GUI).
The communication unit 7 communicates with other information processing apparatuses through a network or a like. It should be noted that the CPU 1, the RAM 2, the ROM 3, the storage unit 4, the input unit 5, the display unit 6, the communication unit 7, and the output unit 8 are connected via a system bus 9 and mutually accessible each other.
FIG. 2 is a diagram for explaining a configuration example of the illegal use research service providing system for image data, according to the first embodiment of the present invention. In FIG. 2, a server system 10 is to provide an illegal use research service, and includes a search server 11 including a function for searching for a similar image, and a management server 12 including a function for managing information concerning a search subject. A member DB (DabaBase) 13 is used to register member (research client) information. A text example DB (DabaBase) 14 is used to register a text example for various notices to send by electronic mail. A research subject DB (DabaBase) 15 is used to register image data or a like subject to research. A research client 20 is a user who sends a research request to server system 10 and receives a research report. Client terminals 211, 212, . . . (hereinafter, often called generally client terminal 211) are computer terminals used by the research clients 20. A network 22 is used to communicate to the server system 10. A Web site group 30 is a group of Web sites 311, 312, 313, . . . (hereinafter, often called generally Web site 311) on the network 22.
The search server 11 includes a similar image searching part 11a that can access the research subject DB 15. The management server 12 includes a research subject registering part 12a, a research condition setting part 12b, and a search result informing part 12c, which can access the member DB 13, the text example DB 14, and the research subject DB 15. Moreover, the research subject DB 15 registers image data 15a subject to the illegal use research, user information 15b including identification information of a Web site managed by a user who receives a user permit of the image data 15a, a research condition 15c, and a feature amount 15d extracted from the image data 15a. For example, the identification information of the Web site included in the user information 15b shows a URL (Uniform Resource Locator) of the Web site. In this embodiment, the server system 10 is configured by these two servers: the search server 11 and the management server 12. Alternatively, these two servers may be integrated in a single server computer. Alternatively, each function included in the server system 10 may be distributed to other server computers and terminal units through a network.
The illegal use research service providing system according to the present invention includes the search subject registering part 12a, the research condition setting part 12b, the similar image searching part 11a, the search result informing part 12c, the member DB 13, the text example DB 14, and the research subject DB 15. A research request form (including the image data and a research condition) sent from the client terminal 211 through the network 22 is registered to the research subject DB 15 by the management server 12 (the research subject registering part 12a and the research condition setting part 12b). The search server 11 (the similar image searching part 11a) searches for the similar image from a Web site group 30 based on the research request form being registered. The management server 12 (search result information part 12c) sends a search result to the client terminal 211.
First, the research subject registering part 12 sets and registers the image data 15a subject to a similar search (for example, picture data, design data, trademark data, name, trademark, logo, and a like) for each research client (organization, or a like) to the research subject DB 15. The image data 15a generally needs a use permit. In a case in that an agreement concerning a use of the image data 15a (for example, use policy or a like) exists, the user information 15b including information concerning the agreement (for example, a counterparty, a URL of the counterparty, a contact person name, an e-mail (electronic mail) address, a subject image, a use policy, or a like) is also registered to the research subject DB 15. Moreover, in a case of a new member registration, in addition to member (research client) information, the user information 15b (a use permit list, an URL that the user manages, the use policy, and the like) may be registered to the member DB 13. In this case, the search server 11 may be accessible to the research subject DB 15 and the member DB 13, and obtain necessary information for a similar image search.
The research condition setting part 12b sets the research condition 15c for research whether or not the image data 15a registered by the research subject registering part 12a is illegally used at the Web site group 30 on the network 22. That is, it is researched whether or not an intellectual property (for example, trademark, name, logo, and a like) set by the research client of this system and being subject to the similar search is used without notice, and then, the research condition 15c is set to prevent from being misidentified or confused by a similar display.
Alternatively, the research condition setting part 12b may set the research condition 15c excluding a Web site registered in the research subject DB 15 and managed by the user from subjects of the illegal use research. That is, since the Web site (URL) registered in the research subject DB 15 is a Web site managed by the user permitted to use, it is considered that the illegal use research is not required. Accordingly, it is possible to effectively conduct the illegal use research by excluding from the subject of the illegal use research predetermined. Moreover, the research condition setting part 12b can set at least any one or some of a data format, a data capacity, and a data size of the image data being a subject of the illegal use research, and also, can set at least any one or some of a domain type, a page type, and a page layer of the Web site being the subject of the illegal use research. Moreover, the research condition setting part 12b sets and register, as the research condition 15c, a research range (the entire or a part of Web or a like), a research schedule (for example, a research is continuously conducted once per day for 6 months, or the like), a research result (for example, the warning e-mail is sent or not, or the like), and a country or a region being a research subject (such as America, China, Europe, or the like).
Furthermore, the research condition 15c will be described in detail.
The research condition 15c is a set of various conditions for improving a search effect by limiting a search range and it is possible to set the following items specifically. Moreover, since the research condition 15c is set in detail to limit the search range, it is possible to reduce a workload of this system and to adjust (discount) a cost of the research.
The illegal use research is conducted under the above-described research condition 15c, that is, by properly combining the above (1) through (9). In this case, in response to the settings of the research condition 15c, an estimate calculating part (described later) is executed. Then, a research cost is estimated, and displayed. Alternatively, by inputting a budget for this research, the type of the research subject may be automatically determined, and a standard research condition may be automatically determined in response to the budget input by the research client.
The similar image searching part 11a of the search server 11 includes a part for calculating the feature amount 15d of the image data 15a registered by the research subject registering part 12a. The feature amount 15d calculated by this feature amount calculating part is registered with the image data 15a to the research subject DB 15. The similar image searching part 11a can extract the feature amount 15d from any one or some of a color, a pattern, a shape, and a layout of the image data 15a as the subject of the illegal use research. The similar image searching part 11a searches for image data identifying or resembling the image data 15a based on the research condition 15c and the feature amount 15d of the image data 15a set by the research condition setting part 12b from the Web site group 30.
As shown in FIG. 3, the similar image searching part 11a automatically extracts and digitalizes a coloration of the entire image, a distribution of color, a composition (distribution of a texture and an edge), a pattern (texture), and a like at an image registration by the feature amount calculating part. Different from a search function utilizing a date, a keyword, a file name, and a like, the similar image searching part 11a searches for image by applying concepts such as the coloration (checks the number of pixels for each color to set as the feature amount), the distribution of color (defines a representative color extracted from each portion of the image as the feature amount), the composition (defines an edge extracted from each portion of the image), and the pattern (analyzes and defines a brightness change for each pixel as the feature amount), which are difficult to express by using character data.
Next, the (search server 11 registers input information that is received, a calculated pattern of the feature amount, and the calculation result to the research subject DB 15 by associating with each other (step S5). Subsequently, the search server 11 determines whether or not all images are registered (step S6). When all images are registered (YES), the search server 11 terminates the feature amount calculating process. On the other hand, when all images are not registered (NO), the search server 11 goes back to the step S4 to repeat the above-described steps.
Furthermore, when the similar image searching part 11a according to the first embodiment of the present invention searches for image data being identical or similar to the image data 15a, the similar image searching part 11a sets a predetermined range to the feature amount 15d of the image data 15a registered research subject DB 15, searches for image data including the feature amount within the predetermined range from the Web site group 30 on the network 22 as the similar image, and obtains the image data searched for as the similar image and a URL of the Web site including the image data.
The search result informing part 12c displays a search result by the similar image searching part 11a as a research report at the client terminal 211 to inform the search result to the research client. In this case, the entire or a part of a text being informed may be registered as a template in the text example DB 14 beforehand. Moreover, the image data, which are searched, may be displayed with the text based on a predetermined classification. Alternatively, the image data, which are searched, may be displayed all together at a special screen.
A person trying the illegal use may falsify an original (research subject) image to be a different image. It can be a purpose to misidentify as the original image. Thus, the person may falsify a part of various feature amounts of the images. For example, in a case of changing only color of a logo or a background of the logo, other features such as a shape, a pattern, or a like are quite similar to the original image but only the feature amount of color is quite different from the original image. As described above, the falsification tendency reports a tendency of a specific feature of the features (color, shape, pattern, or the like), which is most falsified.
Identification information of the Web site includes the domain name/URL, the domain type, and the above-described Web site analyzing method. As the domain name/URL, the domain name or the URL of the Web site excluding an organization and a related organization of the research client from the research subject can be registered as a list.
The domain type can limit a research subject country by the domain type such as jp=Japan, ge=Germany, cn=China, or a like. Moreover, the Web site analyzing method can specify a page layer by clearly determining a layer structure by a Web site transition analysis being based on hyperlink information such as a html tag.
The similar image searching part 11a can set the similarity degree based on the feature amount of the image data obtained as the similar image. The search result informing part 12c may sort the image data in an order of higher similarity degree set by the similar image searching part 11a, and display the image data being sorted with information including at least the identification information (such as the URL) of the Web site including the image data and the similarity degree of the image data, when the search result is display to inform the research client at the client terminal 211. In addition, the search result informing part 12c may individually display the image data having higher similarity degree with detail information based on the similarity degree, individually display the image data having a middle level of the similarity degree without the detail information, and display only image data having lower similarity degree at the same screen, as a display (informing) method.
similarity degree d=K(color)×d(color)+K(edge)×d(edge)+K(pattern)×d(pattern)+K(shape)×d(shape) (1)
The similarity image searching part 11a calculates the feature amount and the distance of the research subject image with respect to each feature amount of the test research subject. This calculation is conducted for all test research subject images. By using the above calculation (1), the similarity degree is calculated for each test research subject image. In addition, the similarity degree is picked up when the similarity degree as a result of the calculation is within the range being set beforehand.
The search result informing part 12c includes a part for sending the warning e-mail to the Web site including the similar image searched by the similar image searching part 11a. When the search result informing part 12c sends the warning e-mail to the Web site 311 including the similar image, the search result informing part 12c may select the text example corresponding to the similarity degree of the similar image from the text example DB 14, set the selected text example to the warning e-mail, and send the warning e-mail including the selected text example from the text example DB 14 to an e-mail address shown in the Web site 311. Alternatively, the search result informing part 12c may send the warning e-mail including the selected text example to the client terminal 211 before sending the warning e-mail to the e-mail address shown in the Web site 311, and send the warning e-mail to the e-mail address shown in the Web site 311 after the research client confirms or modifies the warning e-mail.
Next, when the user ID and the PWD are authenticated (step S16), the research client determines whether or not the research purpose is the illegal use research (step S19). When the research client indicates a research other than the illegal use research (for example, a similar design research or a like) (NO), the research is conducted (step S20). In the step S19, when the research purpose is the illegal use research (YES), the illegal use research concerning the image data is conducted (step S21). The management server 12 registers the image data 15a and the research condition 15c for the research subject to the research subject DB 15 (step S22). The search server 11 calculates the feature amount 15d from the image data 51a registered in the research subject DB 15 (step S23), and searches for the similar image included in the Web site group 30 based on the feature amount 15d being calculated and the research condition 15c (step S24).
Next, the management server 12 determines whether or not to conduct the similar search periodically based on the research condition 15c of the research subject DB 15 (step S29). When the similar search is conducted periodically (YES), the illegal use service providing method advances to the step S24 and searches for the similar image from the Web site group 30 at predetermined intervals defined beforehand. On the other hand, in the step S29, when the similar search is not conducted periodically, for example, the similar search is temporarily conducted (NO), the illegal use research service providing method is terminated. In the step S27, when the warning e-mail is not sent to the Web site (NO), the illegal use research service providing method advances to the step S29.
FIG. 6 is a diagram for explaining a configuration example of the illegal use research service providing system for the image data according to the first embodiment of the present invention. The server system 10 includes the search server 11 and the management server 12, and includes the member DB 13, the text example DB 14, the research subject DB 15, and the feature amount DB 16. In addition, the search server 11 includes the similar image searching part 11a, and the feature amount registering part 11b, and can access the research subject DB 15 and the feature amount DB 16. The management server 12 includes the research subject registering part 12a, the research condition setting part 12b, the search result informing part 12c, and the estimate amount calculating part 12d, and can access the member DB 13, the text example DB 14, and the research subject DB 15. In this system configuration, different from the system configuration shown in FIG. 2, the illegal use research service providing system according to the first embodiment of the present invention includes the feature amount registering part 11b, the estimate amount calculating part 12d, and the feature amount DB 16. The other parts are the same as the parts in the system configuration shown in FIG. 2, and the explanation thereof will be omitted.
The feature amount registering part 11b of search server 11 calculates the feature amount from the image data including the Web site by searching for the Web site group 30 periodically on the network 22, and registers the calculated feature amount to the feature amount DB 16 by associating the calculated feature amount with the URL of each Web site. In the server system 10 according to the first embodiment of the present invention, a search of the similar image is conducted by comparing the feature amount 15d of the image data 15a registered in the research subject DB 15 with the feature amount registered in the feature amount DB 16. That is, the similar image searching part 11a sets a predetermined range to the feature amount 15d of the image data 15a registered in the research subject DB 15 and searches for the feature amount being within the predetermined range from the feature amount registered in the feature amount DB 16 when the similar image searching part 11a searches for the image data which is identical or similar to the image data 15a as the research subject image. As a result the similar image searching part 11a obtains the searched image data corresponding to the feature amount and the URL of the Web site including the searched image data.
The estimate amount calculating part 12d calculates an approximate estimate for an expense of the illegal use research based on the research condition 15c set by the research condition setting part 12b. The management server 12 may inform the estimate amount calculated by the estimate amount calculating part 12d before searching for the similar image by the similar image searching part 11a, and execute the similar image search when the research client approves the estimate amount. Alternatively, a budget range (upper limit of the expense) of the research client may be set, and the similar image search is conducted within this budget range.
A detailed embodiment of the estimate amount calculating part 12d will be described in the following:
(1) reduce the estimate amount each time the research condition 15c.
By setting the research condition 15c in detail, the research range is limited. Accordingly, since a workload to this system is reduced, the expense for the illegal use research service is reduced.
The research subject registering part 12a may register a research history concerning the image data for each research client with the image data subject to the illegal use research to the research subject DB 15. In this case, the research subject registering part 12a may register the number of sending the warning e-mail by the search result informing part 12c as the research history registered in the research subject DB 15 for each Web site including the similar image searched by the similar image searching part 11a. Moreover, the search result informing part 12c may change a warning content of the warning e-mail gradually (for example, an attention content until four times and the warning content after more than four times) by corresponding to the number of sending the warning e-mail registered by the research subject registering part 12a.
FIG. 7 is a diagram for explaining a further system configuration example of the illegal use research service providing system for the image data according to the first embodiment of the present invention. In FIG. 7, the illegal use research service providing system includes the search server 11 and the management server 12 but different organizations independently manage and operate the search server 11 and the management server 12, respectively. The search server 11 includes the similar image searching part 11a, the feature amount registering part 11b, an application service providing part 11c, and a charging part 11d, and can access the feature amount DB 16 and/or the research subject DB 15. The management server 12 includes the research subject registering part 12a, the research condition setting part 12b, the search result informing part 12c and the estimate amount calculating part 12d, and can access the member DB 13, the text example DB 14, and the research subject DB 15.
As shown in FIG. 7, in the present invention, the image searching function included in the search server 11 can be applied to an ASP (Application Service Provider) system in which the image searching function can be provided through the network as an application. In this case, the application service providing part 11c of the search server 11 included in an ASP service provider provides various services as applications through the network to provide various parts (the similar image searching part 11a and/or the feature amount registering part 11b) included in the search server 11, to the management server 12 as a service receiver. Moreover, the charging part 11d charges for a service provided by the application service providing part 11c. A charging method by the charging part 11d may determine a charged amount by corresponding to the research condition (or the research result) such as a frequency of the similar search, the search range, the number of sets of image data as the search subject, the number of search hits, or the like. Alternatively, the charging method may determine the charged amount based on a fixed rate by a predetermined unit such as monthly, daily, a search unit, or a like.
Next, when the user ID and PWD are authenticated in the step S36, it is checked (by the research client) whether or not the research purpose is the illegal use research (step S39). When the research purpose is a research (for example, the similar design research or the like) other than the illegal research (NO), the research is conducted (step S40). In the step S39, when the research purpose is the illegal use research (YES), the illegal use research concerning the image data is conducted (step S40). The management server 12 registers the image data 15a as the research subject image and the research condition 15c to the research subject DB 15 (step S42), and requests the similar image search to the search server 11 (step S43). In this case, the management server 12 may request with the image data 15a being the research subject image to the search server 11.
In FIG. 9, the search server 11 calculates the feature amount 15d from the image data 15a registered in the research subject DB 15 (step S44), and searches for the similar image by matching with the feature amount registered in the feature amount DB 16 based on the feature amount 15d being calculated and the research condition 15c (step S45). Next, the search server 11 sets the similarity degree based on the feature amount with respect to the similar image being searched (step S46), and informs the search result including at least the similar image and image information including the similarity degree of the similarity image to the management server 12 (step S47).
In FIG. 8, the management server 12 sends the research report based on the search result informed from the search server 11 to the research client (client terminal 211) step S48). Next, the management server 12 determines whether or not to send the warning e-mail to the Web site displaying the similar image (step S49). When the warning e-mail is sent to the Web site (YES), the management server 12 generates the warning e-mail corresponding to the similarity degree, and distributes the warning e-mail to the Web site (step S50).
Next, the management server 12 determines whether or not the similar search is conducted periodically, based on the research condition 15c registered in the research subject DB 15 (step S51). When the similar search is conducted periodically (YES), the management server advances to step S52.
In the step S52 in FIG. 8, when the similar search is not conducted periodically, for example, the similar search is temporarily conducted (NO), the illegal use research service providing method is terminated. In the step S49, when the warning e-mail is not sent to the Web site (NO), the illegal use research service providing method advances to the step S51.
Next, data tables registered by the server system 10 will be described. FIG. 10A is a diagram showing an example of a client information management table registering information, which is the research subject, concerning the research client according to the first embodiment of the present invention. FIG. 10B is a diagram showing an example of a trademark information management table registering information concerning a trademark according to the first embodiment of the present invention. In FIG. 10A, in the client information management table, for example, items such as a research client name (user organization name), a registered date, trademark information (shown by an identification number), agreement information (shown by an identification number), valid term, image information (shown by an identification number), an URL, report information, previous research date, and a like are registered. In FIG. 10B, in the trademark information management table, for example, items such as a trademark, a pronunciation, a category, an image size, a letter type, color, a pattern, a data type, an attachment (for example, a HP, a catalog, a manual, or a like), and a like are registered.
In FIG. 11A, the agreement information management table, for each company name contracting the use agreement of the trademark (that is, company name that received the user permit of the trademark), for example, items of a registered date, trademark information, agreement information, valid term, a URL, and a like are registered. Moreover, in FIG. 11B, for example, in the form management table, a form name (for example, a warning form, an advisory form, or a like), a registered date, a form type (template) (shown by an identification number), a similarity degree of the image data (A, B, . . . ), a valid term, and a like are registered. Furthermore, in FIG. 11C, in the similarity degree management table, for each similarity degree of the image data, for example, a form type (template) (shown by an identification number), a valid term, a display method (for example, a detail display, a simple display, or a like), and a like are registered.
FIG. 13 is a diagram showing an example of a research condition setting screen in the illegal use research service providing system according to the first embodiment of the present invention. In FIG. 13, the research condition setting screen 50 includes a registration setting 51 of the research subject image, a registration setting 52 of a research period (report cycle), a type registration setting 53 of the research subject image, a registration setting 54 of a file attribute, a registration setting 55 of a site attribute, and a search start button 56. The research client can select the image data to be research subject by clicking “REFER” button of the registration setting 51 of the research subject image. In this example, image data 51a and 51a are selected image data. Furthermore, in a case in that the image data 51a and 51b are set to be search subject, each check box is checked. Only image data where the check box is checked become the research subject. When two images (image data 51a and 51b) are checked, “or” search is conducted.
Next, in the registration setting 52 of the search period (report cycle), it is possible to indicate to search retrospectively (trace back search). In this trace back search is indicated, a period of displaying the image data 51a and 51b is required to indicate. Moreover, for example, the report cycle/number can be indicated so as to be “daily×once”. The management server 12 distributes the research report periodically in accordance with this indicated schedule.
Next, in the registration setting 54 of the file attribute, the format of the image data requested to search (for example, JPEG, GIF, PNG, or a like) can be indicated. Moreover, a capacity range of the image data requested to search (for example, 100 KB to 1000 KB, or a like) can be indicated. Furthermore, a size range of the image data requested to search (for example, length 100 dots×width 100 dots or a like) can be indicated.
The research client clicks the search start button 56 at the research condition setting screen 50 after setting the above-described items. When the search start button 56 is clicked, a searching process for searching for the similar image is started by the server system 10.
FIG. 14 is a diagram showing an example of a search result displaying screen in the illegal use research service providing system according to the first embodiment of the present invention. In FIG. 14, the search result displaying screen 60 includes an original (search subject) 61, search results 62, 63, and 64. Each of the search results 62, 63, and 64 includes image data searched as the similar image, image information concerning image data, a site displaying the image data, and a link button for linking a text creating screen for creating a text of the warning/attention e-mail. The image information, for example, includes an URL, a file name, a similarity degree, an image size, a file capacity, and a like. These search results are sorted by the similarity degree. When the research client wants to send the warning/attention e-mail to a Web site based on the search result 64, the research client clicks a link 64a to go to the text creating screen for the warning/attention e-mail.
In a second embodiment, the present invention is applied to a proper use research service providing system or apparatus for researching whether or not image data being permitted to user are properly used at Web sites on a network. In the second embodiment, processes, system configurations, screens displayed at a client terminal of a research client are the same as those in the first embodiment and the explanations will be omitted. In the second embodiment, the illegal use research in the first embodiment is replaced with a proper use research. The similarity degree in the first embodiment is replaced with a proper degree. The warning e-mail or the attention e-mail in the first embodiment is replaced with the communication e-mail. Accordingly, only different portions from the first embodiment will be described in the following.
FIG. 18 is a diagram showing a configuration example of the proper use research service providing system for the image data according to the second embodiment of the present invention. In FIG. 18, parts that are the same as the ones in FIG. 2 in the first embodiment are indicated by the same reference numerals and the explanation thereof will be omitted. In FIG. 18, the server system 10 functions to provide the proper use research service in the second embodiment. The Web site group 30a is a group of Web sites 311, 312, 313, . . . (hereinafter, often called generally Web site 311), which are managed by related companies and agents which received the user permit from the research client, on the network 22. In this case, the Web site 311 received and has already had the use permit to use the image data 15a from the research client 20. The image data 15a is a subject of the proper use research.
Generally, the organization manages and monitors a trademark application, and a trademark and regulates allowable color, size, character type, background, and these combinations in the use agreement (use agreement information) in detail. A user permitted to use (for example, a related company, a distributor, a branch, an agent, or a like) complies this regulation and then display the trademark, the naming, the logo of the contract partner at a top page of a related home page, a product, an advertisement, or a like. This use regulation is defined in order to uniformly manage the brand image, including the related companies. Then, even the related company can conduct the same use management as a parent company. In this case, only a user of the related company or the like, which has the use agreement, can use the trademark or the like. In this system, the use agreement information is included in the user information 15B and registered to the research subject DB 15. Therefore, it is possible to determine whether or not the image data 15a is properly used in accordance with the user agreement.
In the second embodiment, the similar image searching part 11a can set the proper degree based on the feature amount of the image data obtained as the similar image. The search result informing part 12c may sort the image data in an order of higher proper degree set by the similar image searching part 11a, and display the image data being sorted with information including at least the identification information (such as the URL) of the Web site including the image data, the proper degree of the image data, and comment information of the image data, when the search result is display to inform the research client at the client terminal 211. In addition, the search result informing part 12c may individually display the image data having higher proper degree with detail information based on the proper degree, individually display the image data having a middle level of the proper degree without the detail information, and display only image data having lower proper degree at the same screen, as a display (informing) method.
proper degree d=K(color)×d(color)+K(edge)×d(edge)+K(pattern)×d(pattern)+K(shape)×d(shape) (2)
In the step S19, the research purpose is the proper use research (YES), the proper use research concerning the image data is conducted (step S21-2). The management server 12 registers the image data 15a, the research condition 15c, and the user information 15b (step S22-2). The search server 11 calculates the feature amount 15d from the image data 15a being registered in the research subject DB 15 (step S23) and searches for the similar image included in the Web site group 30a such as the related company and the like based on the feature amount 15d and the research condition 15c (step S24-2).
Different from the first embodiment, in the step S39, when the research purpose is the proper use research (YES), the proper use research is conducted (step S41-2). The management server 12 registers the image data 15a being the research subject, the research condition 15c, and the user information 15b (a URL of the research subject Web site, use agreement, and a like) to the research subject Db 15 (step S42-2). Then, the management server 12 request the similar image search to the search server 11 (step S43).
In FIG. 23, the search server 11 circulates the research subject Web site group 30 of the related company and the like (step S52-2) and the image data included in the research subject Web site 311 such as related company are searched for (step S53-2). The other steps are conducted similar to the first embodiment (FIG. 8 and FIG. 9).
FIG. 25 is a diagram showing an example of a research condition setting screen in the proper use research service providing system according to the second embodiment of the present invention. In FIG. 25, the research condition setting screen 150 includes a registration setting 151 of the research subject image, a type registration setting 152 of the research subject image, a registration setting 153 of a file attribute, a registration setting 154 of the research site, an estimated amount display 155, and a search start button 156. The research client can select the image data to be research subject by clicking “REFER” button of the registration setting 151 of the research subject image. In this example, image data 151a and 151a are selected image data. Furthermore, in a case in that the image data 151a and 151b are set to be search subject, each check box is checked. Only image data where the check box is checked become the research subject. When two images (image data 51a and 51b) are checked, “or” search is conducted.
Next, in the registration setting 153 of the file attribute, the format of the image data requested to search (for example, JPEG, GIF, PNG, or a like) can be indicated.
Moreover, a capacity range of the image data requested to search (for example, 100 KB to 1000 KB, or a like) can be indicated. Furthermore, a size range of the image data requested to search (for example, length 100 dots×width 100 dots or a like) can be indicated.
16. A server apparatus for conducting an illegal use research of image data requiring a use permit, said server apparatus comprising:
a research subject registering part registering image data received from the research client as a research subject to a research subject database for each research client;
a research condition setting part setting a research condition for research whether or not the image data being registered are illegally used by a Web site on a network;
a similar image searching part calculating a feature amount of the mage data registered by said research subject registering part, and searching for image data being identical or similar to the image data of the research subject based on the feature amount being calculated and the research condition; and
a search result informing part informing a search result by said similar image searching part as a research report to the research client.
17. A method for providing an illegal use research service for image data by a server apparatus connectable to a client apparatus used by a research client requesting the illegal use research for the image data requiring a use permit through a network, said method comprising the steps of:
registering image data received from the client apparatus as research subject to a research subject database for each research client;
setting a research condition for researching whether or not the image data being registered are illegally used;
calculating a feature amount of the image data being registered in said registering image data and searching for image data being identical or similar to the image data of the research subject based on the feature amount being calculated and the research condition; and
informing a search result as a research subject to the research client using the terminal apparatus.
18. The method as claimed in claim 17, wherein said feature amount of at least one of a color, a pattern, a shape, and a layout of the image data as a subject of the illegal use research is calculated.
19. The method as claimed in claim 17, wherein information concerning a user, who received the use permit of the use permit, and identification information of a Web site managed by the user is registered with the image data as the subject of the illegal use research and the feature amount of the image data to the research subject database for each research client.
20. The method as claimed in claim 19, wherein the research condition, which excludes the Web site managed by the user being registered in the research subject database from the subject of the illegal use research, can be set.
21. The method as claimed in claim 17, wherein as the research condition, at least one of a data format, a data capacity, and a data size of the image data as the subject of the illegal use research can be set.
22. The method as claimed in claim 17, wherein as the research condition, at least one of a domain type, a page type, and a page layer of the Web site as the subject of the illegal use research can be set.
23. The method as claimed in claim 17, wherein when image data being identical or similar to the image data as the research subject are searched for, a predetermined range is set for the feather amount of the image data registered in the research subject database, image data having the feature amount being within the predetermined range are searched for as a similar image from image data included in the Web site on the network, and the image data searched as the similar image and identification information of the Web site including the image data are obtained.
24. The method as claimed in claim 17, further comprising the step of circulating the Web site on the network, calculating the feature amount of the image data included in the Web site being circulated, and registering information concerning the calculated feature amount to the feature amount database by relating to the identification information of the Web site,
wherein when image data being identical or similar to the image data as the research subject, a predetermined range is set for the feature amount of the image data registered in the research subject database, the feature amount being within the predetermined range is searched from the feature amounts registered in the feature amount database, and as a result, the image data corresponding to the feature amount being searched and identification information of the Web site including the image data.
25. The method as claimed in claim 23, wherein when the similar image is searched for, the similarity degree is set based on the feature amount with respect to the image data obtained as a similar image, and
wherein when the search result is displayed and informed at the terminal apparatus, image data are sorted in an order of a higher similarity degree, the sorted image data are displayed with image information including at least the identification information of the Web site including the image data and the similarity degree of the image data.
26. The method as claimed in claim 25, wherein the text examples, of which contents are different each other, of the warning e-mail are stored in a text example database, and when the warning e-mail is sent to the Web site including the similar image being searched, a text example corresponding to the similarity degree of the similar image is selected from the text example database, the selected text example is set to the warning e-mail, and the warning e-mail setting the selected text example is sent to an e-mail address included in the Web site.
27. The method as claimed in claim 26, wherein before the warning e-mail setting the selected text example from the text example database is sent to the e-mail address included in the Web site, the warning e-mail is sent to the client apparatus of the research client, and the warning e-mail is sent to the e-mail address included in the Web site after the research client approves or modifies the content of the warning e-mail.
29. A program product for causing a computer to function as a server apparatus for conducting an illegal use research of image data requiring a use permit, said program product comprising the codes for:
registering image data received from the research client as a research subject to a research subject database for each research client;
setting a research condition for research whether or not the image data being registered are illegally used by a Web site on a network;
calculating a feature amount of the mage data registered by said registering image data, and searching for image data being identical or similar to the image data of the research subject based on the feature amount being calculated and the research condition; and
informing a search result by said searching as a research report to the research client.
30. A program product for causing a computer to an illegal use research service for image data by a server apparatus connectable to a client apparatus used by a research client requesting the illegal use research for the image data requiring a use permit through a network, said program product comprising the codes for:
31. A computer-readable recording medium recorded with a program for causing a computer to an illegal use research service for image data by a server apparatus connectable to a client apparatus used by a research client requesting the illegal use research for the image data requiring a use permit through a network, said program comprising the codes for:
46. A server apparatus for conducting a proper use research of image data permitted to use, said server apparatus comprising:
a research condition setting part setting a research condition for research whether or not the image data being registered are properly used by a research subject Web site on a network;
47. A method for providing a proper use research service for image data by a server apparatus connectable to a client apparatus used by a research client requesting the proper use research for the image data permitted to use through a network, said method comprising the steps of:
setting a research condition for researching whether or not the image data being registered are properly used;
48. The method as claimed in claim 47, wherein said feature amount of at least one of a color, a pattern, a shape, and a layout of the image data as a subject of the proper use research is calculated.
49. The method as claimed in claim 47, wherein as the research condition, at least one of a data format, a data capacity, and a data size of the image data as the subject of the proper use research can be set.
50. The method as claimed in claim 47, wherein as the research condition, at least one of a domain type, a page type, and a page layer of the Web site as the subject of the proper use research can be set.
51. The method as claimed in claim 47, wherein in said registering image data registers use agreement information concerning a use agreement of the image data contracted between the research client and the user who received the user permit from the research client, to the research subject database, and said searching for image data includes a checking whether or not image data included in the research subject Web site on the network is used in accordance with the contract contents regulated in the use agreement information.
52. The method as claimed in claim 47, wherein a predetermined range for the feature amount of the image data being registered in the research subject can be set when searching for image data which are identical or similar to the image data being research subject, image data having the feature amount being within the predetermined range can be searched for from image data included in the research subject Web site on the network as a similar image, and the image data searched as the similar imaged and identification information of the research subject Web site including the image data can be specified.
53. The method as claimed in claim 47, further comprising the step of circulating a research subject Web site on the network periodically, calculating the feature amount form the image data included in the research subject Web site being circulated, and registering information concerning the feature amount being calculated to a feature amount database by associating the information with identification information of the research subject Web site, wherein a predetermined range for the feature amount of the image data being registered in the search subject database can be set when searching for image data being identical or similar to the image data being the research subject, the feature amount being within the predetermined range can be searched for from the feature amounts registered in the feature amount database, and the image data corresponding to the feature amount being searched and the identification information of the research subject Web site including the image data as a search result can be specified.
54. The method as claimed in claim 52, wherein:
a proper degree with respect to image data obtained as the similar image based on the feature amount of the image data can be set; and
image data can be sorted in an order of a higher proper degree when displaying and informing the search result at the terminal apparatus, and the image data being sorted can be displayed with image information including at least one of the identification information of the research subject Web site, the proper degree of the image data, and comment information concerning the image data
55. The method as claimed in claim 54, wherein:
text examples showing different contents for a communication e-mail corresponding to the proper degree set for each image data are store in a text example database beforehand;
the communication e-mail is sent to the research subject Web site including the similar image; and
when the communication e-mail is sent to the research subject Web site including the similar image, one text example corresponding to the proper degree of the similar image is selected from the text example database, the selected text example is set to the communication e-mail, and the communication e-mail setting the selected text example is sent to an e-mail address included in the research subject Web site.
56. The method as claimed in claim 55, wherein the communication e-mail setting the selected text example from the text example database is sent to the terminal apparatus of the research client before the communication e-mail is sent to the e-mail address included in the research subject Web site, and the communication e-mail is sent to the e-mail address included in the research subject Web site after the research client confirms or modifies contents of the communication e-mail.
58. A program product for causing a computer to conduct a proper use research of image data permitted to use, said program product comprising the codes for:
setting a research condition for research whether or not the image data being registered are properly used by a research subject Web site on a network;
calculating a feature amount of the mage data being registered, and searching for image data being identical or similar to the image data of the research subject based on the feature amount being calculated and the research condition; and
informing a search result by said similar image searching part as a research report to the research client.
59. A program product for causing a computer to execute a method for providing a proper use research service for image data by a server apparatus connectable to a client apparatus used by a research client requesting the proper use research for the image data permitted to use through a network, said program product comprising the codes for:
Publication number: 20090177628
Patent Grant number: 8121410
Inventors: Hiroyuki YANAGISAWA (Chiba), Yasushi Yamamoto (Kanagawa), Yoshiaki Nishizaki (Kanagawa)
Application Number: 12/260,903
Current U.S. Class: 707/3; Template Matching (e.g., Specific Devices That Determine The Best Match) (382/209); Using A Combination Of Image Content Features (epo) (707/E17.023); Using Distributed Data Base Systems, E.g., Networks, Etc. (epo) (707/E17.032); By Querying, E.g., Search Engines Or Meta-search Engines, Crawling Techniques, Push Systems, Etc. (epo) (707/E17.108); Demand Based Messaging (709/206)
International Classification: G06F 17/30 (20060101); G06K 9/62 (20060101); G06F 15/16 (20060101);