Abstract:
There is provided a digital watermarking detecting device that can accurately detect watermarking information weakened by an attack such as image cut-out, scaling or the like without increasing a calculation amount and a circuit scale. The digital watermarking detecting device includes an extractor 10 for extracting a signal of a specific frequency component from a watermarking embedded image, first orthogonal transformers 11A, 11B for calculating an orthogonally-transformed image of an extraction signal and an orthogonally-transformed image of a watermarking embedded image, amplitude adjusters 12A, 12B for adjusting the amplitudes of the two orthogonally-transformed images in accordance with the difference between the amplitude components of the two orthogonally-trans formed images, a compositor 13 for combining the two amplitude-adjusted orthogonally-transformed images, a second orthogonally-transformer 14 for subjecting the composite signal to orthogonal transformation to achieve a second orthogonally-transformed signal, and an estimator 15 for estimating the watermarking information on the basis of a peak appearing in the second orthogonally-transformed signal.

Description:
CROSS-REFERENCE TO RELATED APPLICATIONS  
       [0001]     This application is based upon and claims the benefit of priority from the prior Japanese Patent Application No. 2005-68556, filed on May 11, 2005; the entire contents of which are incorporated herein by reference.  
       TECHNICAL FIELD  
       [0002]     The present invention relates to a digital watermarking detecting device that is effective to prevent unjust copying of a digital video signal supplied through a recording medium, for example, and a method for the device.  
       BACKGROUND OF THE INVENTION  
       [0003]     In connection with propagation of a device for recording and reproducing digital image data such as a digital VTR, DVD (digital versatile disc) or the like, a large number of digital motion pictures that can be reproduced by such a device as described above have been supplied. Furthermore, various digital motion pictures are being distributed through digital television broadcast through the Internet, a broadcast satellite, a communication satellite, etc., and users are allowed to use high-quality digital motion pictures.  
         [0004]     With respect to digital motion pictures, high-quality copies thereof can be easily made at the digital signal level. Therefore, when neither copy inhibition nor copy control is carried out on these digital motion pictures, there is a risk that they are copied without restriction. Accordingly, in order to prevent unjust copying of digital motion pictures or control the number of generations of copying by regular users, there has been considered a method of adding copy controlling information to digital motion pictures and preventing unjust copying or restricting copying by using the additional information concerned.  
         [0005]     A digital watermarking (electronic watermark) technique is known as a technique of superposing another different additional information on digital motion pictures as described above. According to the digital watermarking technique, various information such as identification information on the owner of copyright of a content (digitalized voice, music, motion picture, still picture or the like) and users of the content, right information of the copyright owner, the using condition of the content, secrete information needed to use the content, the information such as the copy controlling information described above, etc. (hereinafter referred to as “watermarking information”) is embedded in the content concerned, and copyright protection containing control of use and copy control is afterward carried out by detecting the watermarking information from the content as occasion demands or secondary use is promoted.  
         [0006]     Various method have been proposed as a digital watermarking system, and a system using a spread spectrum technique is known as one of these digital watermarking systems. According to this system, watermark information is embedded in digital motion pictures according to the following procedure.  
         [0007]     [Step E 1 ] 
         [0008]     An image signal is multiplied by PN (Pseudorandom Noise) sequence to carry out spread spectrum modulation.  
         [0009]     [Step E 2 ] 
         [0010]     The image signal that has been subjected to spread spectrum modulation is subjected to frequency-transformation (for example, DCT transformation). [Step E 3 ] 
         [0011]     Watermarking information is embedded by changing the value of a specific frequency component.  
         [0012]     [Step E 4 ] 
         [0013]     Inverse frequency transformation (for example, IDCT transformation) is carried out.  
         [0014]     [Step E5] 
         [0015]     Inverse spread spectrum modulation is carried out (the image signal is multiplied by the same PN sequence as step E 1 ).  
         [0016]     Detection of the watermarking information from the digital motion picture in which the watermarking information is embedded as described above is carried out according to the following procedure.  
         [0017]     [Step D 1 ] 
         [0018]     An image signal is multiplied by PN (Pseudorandom Noise) sequence (the same PN sequence as step E 1 ) to carry out spread spectrum modulation.  
         [0019]     [Step D 2 ] 
         [0020]     The image signal that has been subjected to the spread spectrum modulation is subjected to frequency transformation (for example, DCT transformation).  
         [0021]     [Step D 3 ] 
         [0022]     The value of a specific frequency component is noted and watermarking information embedded is extracted.  
         [0023]     A technique for detecting watermarking information through the correlation (mutual correlation) between an extraction signal achieved by extracting an input image signal and an image having a watermarking embedded therein has been proposed as a method for detecting digital watermarking embedded in a motion picture in which an image signal is embedded according to watermarking information. For example, this technique is disclosed in Patent Document 1 (claim  2 ,  FIG. 7  of JP-A-2002-325233) and Patent Document 2 (claim  1 ,  FIG. 1  of JP-A-2002-218404).  
         [0024]     When digital watermarking is applied to prevent unauthorized use, digital copyrighted works are required to have such a property (robustness) that watermarking information is not lost or falsified by various kinds of operations or intentional attacks which are assumed to be normally conducted on digital copyrighted works. Cut-out of images, scaling (enlargement/reduction), etc. may be considered as an attack of disenabling detection of watermarking information from a digital image in which the watermarking information is embedded.  
         [0025]     According to the conventional technique, when an image suffering such an attack is input, the processing of estimating PN sequence used in step E 1  when watermarking information is embedded is first carried out when the watermarking information is detected, and synchronization of the PN sequence is restored. Thereafter, the processing of the steps D 1  to D 3  is carried out to extract the embedded watermarking information. When the synchronization of the PN sequence is restored from only the image signal, it is required to carry out such a searching operation that the processing is tried by using plural candidates and a candidate for which the detection can be carried out is adopted as the watermarking information. Therefore, this method has a problem that the calculation amount and the circuit scale are increased. Furthermore, with respect to an image suffering an attack, the watermarking information of the image is weakened, and thus even when cut-out or scaling of the image is found out and the detection adapted to the cut-out or scaling of the image is carried out, the watermarking information cannot be detected.  
       BRIEF SUMMARY OF THE INVENTION  
       [0026]     The present invention has an object to provide a digital watermarking detecting device that can more accurately detect watermarking information weakened by an attack such as image cut-out, scaling or the like without increasing a calculation amount and a circuit scale, and a method for the digital watermarking detecting device.  
         [0027]     According to embodiments of the present invention, a digital watermarking detecting device for detecting watermarking information of a watermarking-embedded image when a specific frequency component signal extracted from an embedding target image is converted according to the watermarking information and the watermarking-embedded image having the watermarking information electrically embedded therein is generated, comprises: an extracting processor unit for extracting an extraction signal of the specific frequency component from the watermarking-embedded image by the same extraction method as the digital watermarking embedding device; a first orthogonal transforming processor unit for calculating an orthogonally-transformed image of the extraction signal and an orthogonally-transformed image of the watermarking-embedded image; an amplitude adjusting processor unit for adjusting both or one of the amplitudes of the two orthogonally-transformed images in accordance with the difference between the amplitude components of the two orthogonally-transformed images; a composition processor unit for combining the two orthogonally-transformed images thus adjusted in amplitude to achieve a composite signal; a second orthogonal transforming processor unit for subjecting the composite signal to orthogonal transformation or inverse orthogonal transformation to achieve a second orthogonally-transformed signal; and a watermarking information estimating processor unit for estimating the watermarking information on the basis of a peak appearing in the second orthogonally-transformed signal.  
         [0028]     According to the embodiments of the present invention, the watermarking information can be accurately detected irrespective of an attack such as image cut-out, scaling or the like without increasing a calculation amount and a circuit scale. 
     
    
     BRIEF DESCRIPTION OF THE DRAWINGS  
       [0029]      FIG. 1  is a block diagram showing the construction of a digital watermarking detecting device according to a first embodiment of the present invention;  
         [0030]      FIG. 2  is a block diagram showing the construction of a digital watermarking detecting device according to a second embodiment of the present invention;  
         [0031]      FIG. 3  is a flowchart showing the procedure of a digital watermarking detecting method according to the first embodiment;  
         [0032]      FIG. 4  is a flowchart showing the procedure of a digital watermarking detecting method according to the second embodiment;  
         [0033]      FIG. 5  is a block diagram showing the construction of a digital watermarking detecting program according to the first embodiment;  
         [0034]      FIG. 6  is a block diagram showing the construction of a digital watermarking detecting program according to the second embodiment;  
         [0035]      FIG. 7  is a block diagram showing the construction of a digital watermarking embedding device according to the first embodiment;  
         [0036]      FIG. 8  is a block diagram showing the construction of a digital watermarking embedding device according to the second embodiment;  
         [0037]      FIG. 9  is a diagram showing phase shift of an extracting signal;  
         [0038]      FIG. 10  is a diagram showing examples of peak search of a correlation value and watermarking information detection in the digital watermarking detecting device;  
         [0039]      FIG. 11  is a diagram showing the concept of a phase restricted correlating method;  
         [0040]      FIG. 12  is a diagram showing a seventh amplitude adjusting method;  
         [0041]      FIG. 13  is a diagram showing a first amplitude adjusting method;  
         [0042]      FIG. 14  is a diagram showing a second amplitude adjusting method;  
         [0043]      FIG. 15  is a diagram showing a third amplitude adjusting method;  
         [0044]      FIG. 16  is a diagram showing a fourth amplitude adjusting method;  
         [0045]      FIG. 17  is a diagram showing a fifth amplitude adjusting method;  
         [0046]      FIG. 18  is a diagram showing a sixth amplitude adjusting method; and  
         [0047]      FIG. 19  is a diagram showing a hardware construction of the digital watermarking detecting device according to the first and second embodiments. 
     
    
     DETAILED DESCRIPTION OF THE INVENTION  
     First Embodiment  
       [0048]     A digital watermarking embedding device and a digital watermarking detecting device according to a first embodiment of the present invention will be described.  
         [0000]     (Digital Watermarking Embedding Device)  
         [0049]     First, the digital watermarking embedding device according to the first embodiment will be described with reference to  FIGS. 7 and 9 .  
         [0050]      FIG. 7  is a block diagram showing the basic construction of the digital watermarking embedding device.  
         [0051]     A digitalized image signal of a motion picture or still picture is input to the digital watermarking embedding device as an image in which watermarking information should be embedded (hereinafter referred to as “embedding target image  103 ”. The embedding target image signal  103  may contain both of a bright signal and a color difference signal, however, it may contain only the brightness signal. The embedding target image signal  103  is branched to three parts and input to a specific frequency component extractor  20 , a feature amount extractor  21  and a watermarking information superposing portion  23 .  
         [0052]     The specific frequency component extractor  20  comprises a digital filter of the frequency area, for example, a low pass filter or high pass filter that has a predetermined cut-off frequency, or a band pass filter having a predetermined passband center frequency, and extracts a specific frequency component, for example, a relatively high frequency component from the embedding target image signal  103 . In the following description, an output signal from the specific frequency component extractor  20  will be referred to as “specific frequency component signal”.  
         [0053]     The specific frequency component output from the specific frequency component extractor  20  is converted in phase and amplitude by a phase and amplitude converter  22 . In this case, only the phase may be converted or only the amplitude may be converted. Watermarking information  102  corresponding to digital information to be embedded in the embedding target image signal  103  is supplied to the phase and amplitude converter  22 .  
         [0054]     The phase and amplitude converter  22  is designed so as to subject a specific frequency component signal to phase conversion of a predetermined inherent phase conversion amount and, amplitude conversion of a predetermined inherent amplitude conversion amount. Specifically, the phase conversion of the phase amplitude converter  22  is implemented by a single or plural digital phase shifters, and the phase conversion amount corresponds to the phase shift amounts of the phase shifters.  
         [0055]      FIG. 9  is a diagram showing the aspect of the phase shift carried out by a phase converter  112 . In this case, the specific frequency component signal is simply phase-shifted while keeping the waveform thereof. Specifically, the amplitude conversion of the phase and amplitude converter  22  is carried out by a single or plural exclusive OR circuits or digital multipliers, and the amplitude conversion amount is a coefficient to be multiplied to the input specific frequency component signal. Watermarking information  102  is input to the phase and amplitude converter  22 , and the phase conversion amount (phase shift amount) of the phase and amplitude converter  22  and the amplitude conversion amount (coefficient) are controlled according to the watermarking information  102 .  
         [0056]     Furthermore, a feature amount of the embedding target image signal  103 , for example, activity representing the complexity degree of an image is extracted by a feature amount extractor  21 . The information on the feature amount is input to the phase and amplitude converter  22 . In the phase and amplitude converter  22 , the phase conversion amount (phase shift amount) and the amplitude conversion amount (coefficient) are controlled in accordance with the input feature amount. The feature extractor  21  is not indispensable, and it may be omitted.  
         [0057]     The specific frequency component signal that has been subjected to phase conversion and amplitude conversion by the phase and amplitude converter  22  is supplied as an embedding signal by the watermarking information superposing portion  23  comprising a digital adder, and superposed on the embedding target image signal  103 . That is, the specific frequency component signal extracted by the specific frequency component extractor  20  is subjected to phase conversion and amplitude conversion inherent to the digital watermarking embedding device by the phase and amplitude converter  22 , and also one or both of the phase conversion amount and the amplitude conversion amount are controlled by the watermarking information  102 . Therefore, the watermarking embedded image  101  in which the watermarking information  102  is embedded in the embedding target image signal  103  is generated in the watermarking information superposing portion  23 .  
         [0058]     The specific frequency component signal which is extracted by the specific frequency component extractor  20  and subjected to phase and amplitude conversion by the phase and amplitude converter  22  may exist over plural channels. That is, in this case, specific frequency component signals of plural channels are superposed on the embedding target image signal  103  in the watermarking information superposing portion  23 .  
         [0059]     As described above, the image signal having the watermarking information embedded therein (hereinafter referred to as “watermarking embedded image signal- 101 ”) is recorded in a recording medium by a digital image recording and reproducing device such as a DVD system or the like, or transmitted through a transmission medium such as the Internet, a broadcast satellite, a communication satellite or the like.  
         [0000]     (Digital Watermarking Detecting Device)  
         [0060]     A first embodiment of a digital watermarking detecting device when the watermarking embedded image signal  101  described above is detected will be described with reference to the drawings.  
         [0061]     The digital watermarking detecting device according to the first embodiment will be described with reference to  FIGS. 1, 3 ,  5  and  9  to  19 .  
         [0000]     (1) Construction of Digital Watermarking Detecting Device  
         [0062]      FIG. 1  shows the construction of a digital watermarking detecting device according to the first embodiment.  
         [0063]     The watermarking embedded image signal  101  of  FIG. 1  in which the specific frequency component signal is controlled to be embedded according to the watermarking information  102  by the digital watermarking embedding device described above is input through a recording medium or transmission medium. It is assumed that a digital signal “ 1 ” or “ 0 ” is embedded as watermarking information.  
         [0064]     Only a specific component is extracted from the watermarking embedded image signal  101  by an extractor  10 . The extractor  10  is a digital filter of the same frequency area as the specific frequency component extractor used in the digital watermarking embedding device described above, for example, a low pass filter or high pass filter that has a predetermined cut-off frequency, or a band pass filter having a predetermined passband center frequency, and extracts a specific frequency component, for example, a relatively high frequency component signal from the watermarking embedded image signal  101 . The signal thus extracted will be referred to as “extraction signal”).  
         [0065]     The extraction signal extracted by the extractor  10  is subjected to orthogonal transformation processing such as orthogonal transformation or the like by a first orthogonal transformer  11 A, and the watermarking embedded image signal  101  is subjected to orthogonal transformation processing such as orthogonal transformation or the like by a first orthogonal transformer  11 B. There may be also considered such a situation that the extractor extracts all the frequency components.  
         [0066]     The amplitude component of the first orthogonal transformer  11 A is adjusted in amplitude by an amplitude adjuster  12 A so that the difference thereof from the amplitude component of the first orthogonal transformer  11 B is suppressed to a predetermined range. Likewise, the amplitude component of the first orthogonal transformer  11 B is adjusted in amplitude by an amplitude adjuster  12 B so as to approach to the amplitude component of the first orthogonal transformer  11 A.  
         [0067]     The two signals after the amplitude adjustment described above are subjected to complex composition by a compositor  13 .  
         [0068]     The composite signal after the complex composition is subjected to orthogonal transformation or inverse orthogonal transformation by the second orthogonal transformer  14 . The orthogonal transformation in this case is required to be paired with the transformation in the first orthogonal transformation, and when Fourier Transform is used for the first orthogonal transformation, the second orthogonal transformation must be Fourier Transform or inverse Fourier Transform.  
         [0069]     The composite signal after the second orthogonal transformation is input to an estimator  15 . A method of the estimator  15  estimating the watermarking information  102  from the composite signal after the transformation will be described with reference to  FIGS. 9 and 10 . It is assumed that a digital signal “ 1 ” or “ 0 ” is embedded as the watermarking information as described above.  
         [0070]     As shown in  FIG. 9 , the correlation between the transformed composite signal being phase-shifted and the original non-phase-shifted composite signal is calculated. The relationship between the mutual correlation value and the phase shift amount is shown in  FIG. 10 .  
         [0071]     As shown in  FIG. 10 , when variation of the mutual correlation value is observed, a peak appears at the position of some phase shift amount, and the polarity of the peak represents the watermarking information  102 . For example, when the watermarking embedded image signal  101  is suffering a scaling attack, the phase shift amount of the specific frequency component signal thus attacked is made different from the phase shift amount given to the specific frequency component signal in the digital watermarking embedding device.  
         [0072]     Therefore, in this embodiment, the phase shift amount is continuously or stepwise controlled by the estimator  15 , a peak of the mutual correlation value output in connection with the above control is searched, and the watermarking information is estimated and detected on the basis of the polarity of the peak thus searched. The peak of the mutual correlation value takes one of positive and negative values in accordance with the value of the watermarking information. For example, in the case of  FIG. 10 , when the peak has a positive value, the watermarking information is judged as “ 1 ”. When the peak has a negative value, the watermarking information is judged as “ 0 ”. As described above, for the image suffering the scaling attack, the watermarking information  102  detected by the estimator  15  is output.  
         [0073]     As described above, according to this embodiment, the extraction signal is extracted from the watermarking embedded image signal, and the watermarking information is detected on the basis of the mutual correlation result of the phase restricted correlation between the extraction signal and the watermarking embedded image signal. In this case, the peak of the correlation value can be searched by carrying out the correlation calculation while varying the phase, and thus the watermarking information can be also easily detected from the embedded image signal suffering the scaling attack.  
         [0000]     (2) Phase Restricted Correlation Method  
         [0074]     The correlation method that restricts the phase as described above is called as “phase restricted correlation method”, and this method will be described hereunder with reference to  FIG. 11 .  
         [0075]     The phase restricted correlation: POC (Phase Only Correlation) is a method of calculating the correlation (similarity) of an input image  31  to be allocated with an original registered image  30 .  
         [0076]     First, the digitally-signalized registered image  30  is mathematically processed by orthogonal transformation to be decomposed into amplitude  32 A (shading data) and phase  33 A (contour data of an image). Furthermore, the digitally-signalized input image  31  is also mathematically processed by orthogonal transformation to be decomposed into amplitude  32 B (shading data) and phase  33 B (contour data of an image).  
         [0077]     Secondly, the amplitude  33 B of the decomposed registered image  30  is subjected to amplitude compression. This is because this algorithm is an algorithm for collation with the phase  33 B of the input image  31 , that is, an algorithm for image processing of the correlation by using only the phase information without using the amplitude information containing no shape information in the above two information. Likewise, the amplitude  32 B of the decomposed input image  31  is also subjected to amplitude compression. A method of fixing the amplitude to  1  over all the frequencies is generally used as the amplitude compression method.  
         [0078]     Thirdly, a composite image  34  is formed from the two phase information of the registered image  30  and the input image  31 , and inverse orthogonal transformation is carried out on the composite image to thereby achieve a correlated image  35 .  
         [0079]     The phase restricted correlation is completely different from the conventional two-dimensional correlation method and the conventional feature extracting method that use the amplitude information, and has a feature that it is a high resistance to external disturbance and has no large error.  
         [0000]     (2-1) Conventional Amplitude Compression Method  
         [0080]     In the conventional phase restricted correlation, the amplitude is fixed to 1 over all the frequencies as described above.  
         [0081]     However, when an attack such as image cut-out, scaling or the like is assumed, the amplitude error (difference) between before and after attacked is expanded because the amplitude is fixed to 1, and thus it is estimated that the resistance to the attack is not high.  
         [0082]     Therefore, the two amplitude values to be correlated with each other are adjusted so as to approach to each other in order to prevent the amplitude error from expanding, whereby it is expected that the resistance to the attack is increased.  
         [0083]     An example of an amplitude adjusting unit will be described hereunder.  
         [0000]     (2-2) Amplitude Adjusting Method of this Embodiment  
         [0084]     An amplitude adjusting method for adjusting the amplitude of the orthogonally-transformed images of an extraction signal and a watermarking embedded image in this embodiment will be described in turn.  
         [0000]     (2-2-1) First Amplitude Adjusting Method  
         [0085]     A first amplitude adjusting method of the amplitudes of the orthogonally-transformed images of the extraction signal and the watermarking embedded image will be described with reference to  FIG. 13 .  
         [0086]      FIG. 13  is a diagram showing an example of an amplitude adjustment of suppressing the magnitude difference between the amplitude components of the orthogonally-transformed images of the extraction signal and the watermarking embedded image to a predetermined range, and the amplitude is adjusted by the amplitude adjuster  12 A of the extraction signal.  
         [0087]     The magnitude of the amplitude of the orthogonally-transformed image of the extraction signal input to the amplitude adjuster  12 A (hereinafter referred to merely as “extraction signal amplitude”)  1 A is calculated, and then compared with the magnitude of the amplitude  2 A of the orthogonally-transformed image of the watermarking embedded image (hereinafter referred to merely as “watermarking embedded image amplitude”). Since the amplitude  1 A of the extraction signal is larger than the amplitude  2 A of the watermarking embedded image as shown in  FIG. 13 , the magnitude of the amplitude  1 A of the extraction signal is adjusted by amplitude adjustment so that the difference in magnitude between the amplitude  1 A of the extraction signal and the amplitude  2 A of the watermarking embedded image is suppressed to a predetermined range.  
         [0088]     In this example, the amplitude adjustment of the amplitude adjuster  12 A is carried out, however, the same amplitude adjustment may be carried out on the amplitude adjuster  12 B. Furthermore, the same amplitude adjustment may be carried out in some specific frequency band.  
         [0000]     (2-2-2) Second Amplitude Adjusting Method  
         [0089]     A second amplitude adjusting method of the amplitudes of the orthogonally-trans formed images of the extraction signal and the watermarking embedded image will be described with reference to  FIG. 14 .  
         [0090]      FIG. 14  is a diagram showing an example of the amplitude adjustment of suppressing the difference in gradient between the amplitude components of the two orthogonally-transformed images to a predetermined range, and the amplitude is adjusted by the amplitude adjuster  12 A of the extraction signal.  
         [0091]     The gradient of the amplitude  3 A is calculated from the extraction signal input to the amplitude adjuster  12 A, and compared with the gradient of the amplitude  4  A of the watermarking embedded image. Since the amplitude  3 A of the extraction signal is larger than the amplitude  4 A of the watermarking embedded image as shown in  FIG. 14 , the magnitude of the amplitude  3 A of the extraction signal is adjusted by amplitude adjustment so that the difference in gradient between the amplitude  3 A of the extraction signal and the amplitude  4 A of the watermarking embedded image is suppressed to a predetermined range.  
         [0092]     In this example, the amplitude adjustment of the amplitude adjuster  12 A is carried out. However, the same amplitude adjustment may be carried out with respect to the amplitude adjuster  12 B. Furthermore, the same amplitude adjustment may be carried out in some specific frequency band.  
         [0000]     (2-2-3) Third Amplitude Adjusting Method  
         [0093]     A third amplitude adjusting method of the amplitudes of the orthogonally-transformed images of the extraction signal and the watermarking embedded image will be described with reference to  FIG. 15 .  
         [0094]      FIG. 15  is a diagram showing an example of amplitude adjustment in which when there is a frequency at which the magnitude of the amplitude of the orthogonally-transformed image of the extraction signal or the watermarking embedded image is smaller than a predetermined threshold value, the magnitude of each of the two amplitudes is reduced to be less than the predetermined threshold value at the frequency concerned. In this example, the amplitude is adjusted by the amplitude adjuster  12 A of the extraction signal.  
         [0095]     It is checked whether there is any frequency at which the magnitude of each of the amplitude  5 A of the extraction signal and the amplitude  6 A of the watermarking embedded image is smaller than a predetermined threshold value. In this example, it is found that the amplitude  6 A is smaller than the threshold value at high frequencies. Therefore, the amplitude at the high frequencies of the amplitude  5 B of the extraction signal is reduced to be less than the threshold value by amplitude adjustment.  
         [0096]     In this example, the amplitude adjustment of the amplitude adjuster  12 A is carried out, however, the same amplitude adjustment may be carried out on the amplitude adjuster  12 B. Furthermore, In the above example, the high frequency component is subjected to the amplitude adjustment, however, the same amplitude adjustment may be carried out at some specific frequency band.  
         [0000]     (2-2-4) Fourth Amplitude Adjusting Method  
         [0097]     A fourth amplitude adjusting method for the amplitudes of the orthogonally-transformed images of the extraction signal and the watermarking embedded images will be described with reference to  FIG. 16 .  
         [0098]      FIG. 16  is a diagram showing an example of the amplitude adjustment of applying a filter to the amplitude of the orthogonally-transformed image of the extraction signal or the watermarking embedded image so that the difference between the two amplitudes is suppressed to a predetermined range. In this example, the amplitude is adjusted by the amplitude adjuster  12 A of the extraction signal.  
         [0099]     A digital filter having the same amplitude characteristic as the amplitude  8 A of the watermarking embedded image is applied to the amplitude  7 A of the extraction signal to carry out the amplitude adjustment, thereby achieving the amplitude  7 B of the extraction signal.  
         [0100]     In this example, the amplitude adjustment of the amplitude adjuster  12 A is carried out, however, the same amplitude adjustment may be carried out on the amplitude adjuster  12 B. Furthermore, in the above example, the amplitude adjustment is carried out by applying filtering over all the frequency band. However, the same amplitude adjustment may be carried out in some frequency band.  
         [0000]     (2-2-5) Fifth Amplitude Adjusting Method  
         [0101]     A fifth amplitude adjusting method for the amplitudes of the orthogonally-transformed images of the extraction signal and the watermarking embedded image will be described with reference to  FIG. 17 .  
         [0102]      FIG. 17  is a diagram showing an example of the amplitude adjustment that when the amplitude of the orthogonally-transformed image of the extraction signal exceeds a specific threshold value (hereinafter referred to as “threshold value  1 ”), the amplitude is fixed to the threshold value  1 , and also when the amplitude of the orthogonally-transformed image of the watermarking embedded image exceeds a threshold value (hereinafter referred to as “threshold value  2 ”), the amplitude is fixed to the threshold value  2 . The threshold value  1  and the threshold value  2  are different from each other.  
         [0103]     The amplitude  9 A of the extraction signal is compared with the threshold value  1 , and it is judged whether the amplitude  9 A exceeds the threshold value  1 . If the amplitude  9 A exceeds the threshold value  1 , the amplitude  9 A is fixed to the threshold value  1 . Furthermore, the amplitude  10 A of the watermarking embedded image is compared with the threshold value  2 . If the amplitude  10 A is judged to exceed the threshold value  2 , the amplitude  10 A is fixed to the threshold value  1 . Accordingly, the amplitude  9 B of the extraction signal and the amplitude  10 B of the watermarking embedded image are achieved.  
         [0104]     The threshold value  1  and the threshold value  2  may be set to different values or the same value. Furthermore, in the above example, the amplitude is compared with the threshold value over all the frequency band. However, the same amplitude adjustment may be carried out in some specific frequency band.  
         [0000]     (2-2-6) Sixth Amplitude Adjusting Method  
         [0105]     A sixth amplitude adjusting method for the amplitudes of the extraction signal and the watermarking embedded image will be described with reference to  FIG. 18 .  
         [0106]      FIG. 18  is a diagram showing an example of the amplitude adjustment in which the amplitude of the orthogonally-transformed image of the extraction signal or the watermarking embedded image is subjected to constant number multiplication or added with a constant to make the two amplitudes equal to each other in average or power, and when the two amplitudes exceed the same specific threshold value, they are fixed to the threshold value.  
         [0107]     The average value of the amplitude  11 A of the extraction signal is compared with the average value of the amplitude  12 A of the watermarking embedded image, and a constant is added to the amplitude  12 A of the watermarking embedded image so that the average value of the amplitude  12 A of the watermarking embedded image is equal to the average value of the amplitude  11 A of the extraction signal. It is judged whether each of the amplitude  11 A of the extraction signal and the amplitude  12 B of the watermarking embedded image exceeds a threshold value  3 . If the amplitude exceeds the threshold value  3 , the amplitude is fixed to the threshold value  3 , so that the amplitude  11 B of the extraction signal and the amplitude  12 C of the watermarking embedded image are achieved.  
         [0108]     The power of the amplitude may be used in place of the average value of the amplitude, and also the constant number multiplication may be used in place of the addition of the constant.  
         [0109]     Furthermore, the amplitude is compared with the threshold over all the frequency band, however, the same amplitude adjustment may be carried out in some specific frequency band.  
         [0000]     (2-2-7) Seventh Amplitude Adjusting Method  
         [0110]     A seventh amplitude adjusting method for the amplitudes of the orthogonally-transformed images of the extraction signal and the watermarking embedded images will be described with reference to  FIG. 12 .  
         [0111]      FIG. 12  is a diagram showing an example of the amplitude adjuster  12 A.  
         [0112]     With respect to the extraction signal input to the amplitude adjuster  12 A, an attack which the watermarking embedded image has suffered is estimated by the attack estimator  40 . That is, the variation applied to the watermarking embedded image is estimated on the basis of the amplitude characteristic. The amplitude is adjusted in conformity with the estimated attack by the amplitude adjuster  41 , and then output from the amplitude adjuster  12 A.  
         [0113]     As described above, the amplitude is varied in conformity with each of assumed attacks, whereby the resistance to each attack can be enhanced.  
         [0114]     In this embodiment, the attack estimator is contained in the amplitude adjuster  12 A, however, the attack estimator may be disposed out of the amplitude adjuster  12 A. When a predicted d attack is restricted, the amplitude adjustment may be carried out without estimating any attack.  
         [0115]     Furthermore, the same function may be provided to not only the amplitude adjuster  12 A, but also the amplitude adjuster  12 B.  
         [0116]     Still furthermore, plural amplitude adjusters may be provided, and an amplitude adjuster to be selected from these amplitude adjusters may be changed in accordance with the type of an assumed attack. The number of amplitude adjusters to be selected is not limited, and it may be set in conformity with the types of assumed attacks.  
         [0000]     (2-2-8) Eighth Amplitude Adjusting Method  
         [0117]     The above seven adjusting methods may be successively applied to the watermarking embedded image, and the phase adjusting method having the highest correlation may be afterwards used.  
         [0000]     (2-2-9) Other Amplitude Adjusting Methods  
         [0118]     The eight examples of the amplitude adjusting method have been described above, and the amplitude adjustment may be carried out by any combination of these examples.  
         [0000]     (3) Calculation Amount in Orthogonal Transformation  
         [0119]     Here, the calculation amount in the orthogonal transformation when FFT (Fast Fourier Transform) is used for the orthogonal transformation of this embodiment will be described. It is assumed that an input image comprises N lines and M columns.  
         [0120]     The calculation amount of two-dimensional FFT is as follows.  
         1   2     ×   N   ×   M   ×     (       Log   ⁢           ⁢   M     +     Log   ⁢           ⁢   N       )         
 
         [0121]     Furthermore, in this embodiment, the following calculation amount is needed because three orthogonal transformations (first orthogonal transformation/second orthogonal transformation of two images) are used.  
         3   2     ×   N   ×   M   ×     (       Log   ⁢           ⁢   M     +     Log   ⁢           ⁢   N       )         
 
 (4) Procedure of Digital Watermarking Detecting Method 
 
         [0122]     Next, the procedure of the digital watermarking detecting method according to this embodiment will be described with reference to the flowchart of  FIG. 3 .  
         [0123]     Only the specific frequency component is extracted from the watermarking embedded image signal  101  in extraction step S 10 . This step corresponds to the digital filter having the same frequency area as the specific frequency component extractor used in the digital watermarking embedding step to be paired as described above.  
         [0124]     The signal extracted in the extraction step S 10  is subjected to orthogonal transformation processing such as Fourier Transform or the like in the first orthogonal transformation step S 11 B. The watermarking embedded image signal  101  is subjected to orthogonal transformation processing such as Fourier Transform or the like in the first orthogonal transformation step S 11 A.  
         [0125]     The amplitude component of the first orthogonal transformation step S 11 A is adjusted in amplitude in the amplitude adjusting step S 12 A so as to approach to the amplitude component of the first orthogonal transformation step S 11 B. Likewise, the amplitude component of the first orthogonal transformation step S 11 B is adjusted in amplitude in the amplitude adjusting step S 12 B so that the difference thereof from the amplitude component of the first orthogonal transformation step S 11 A is suppressed to a predetermined range.  
         [0126]     The two signals after the amplitude adjustment are subjected to complex composition in a composition step S 13 .  
         [0127]     The orthogonal transformation or the inverse orthogonal transformation is carried out on the signal after the complex composition in the second orthogonal transformation step S 14 . The orthogonal transformation in this case is required to be paired with the transformation in the first orthogonal transformation. When Fourier Transform is used as the first orthogonal transformation, the second orthogonal transformation uses Fourier Transform or Inverse Fourier Transform.  
         [0128]     The data after the second orthogonal transformation is supplied to an input in estimating step S 15 . In the estimating step S 15  of the watermarking information, the peak of the mutual correlation value is searched while phase-shifting is carried out as shown in  FIGS. 9 and 10 , whereby the water information is estimated and detected. When the variation of the correlation value is viewed, a peak appears at the position of some phase shift amount, and the polarity of this peak represents the watermarking information  102 .  
         [0000]     (5) Construction of Digital Watermarking Detecting Program  
         [0129]     Next, the construction of the digital watermarking detecting program according to the embodiment will be described with reference to  FIG. 5 .  
         [0130]     Only the specific frequency component is extracted from the watermarking embedded image signal  101  by an extraction function F 10 . The extraction function is a digital filter having the same frequency band as the specific frequency component extraction function used for the digital watermarking embedding operation, which is paired with the extraction function.  
         [0131]     The extraction signal extracted by the extraction function F 10  is subjected to the orthogonal transformation processing such as Fourier Transform by a first orthogonal transformation function F 11 B. The watermarking embedded image signal  101  is subjected to the orthogonal transformation processing such as Fourier Transform by the first orthogonal transformation function F 11 A.  
         [0132]     The amplitude component of the first orthogonal transformation function F 11 A is adjusted in amplitude by an amplitude adjusting function F 12 A so that the difference thereof from the amplitude component of the first orthogonal transformation function F 11 B is suppressed to a predetermined range, and likewise the amplitude component of the first orthogonal transformation function F 11 B is adjusted in amplitude by an amplitude adjusting function F 12 B so as to approach to the amplitude component of the first orthogonal transformation function F 11 A.  
         [0133]     The two signals after the amplitude adjustment are subjected to complex composition by a composition function F 13 .  
         [0134]     The signal after the complex composition is subjected to orthogonal transformation or inverse orthogonal transformation by a second orthogonal transformation function F 14 . The orthogonal transformation at this time is required to be paired with the transformation in the first orthogonal transformation, and when Fourier Transform is used as the first orthogonal transformation, Fourier Transform or inverse Fourier Transform is used as the second orthogonal transformation.  
         [0135]     The data after the second orthogonal is supplied to the input of an estimating function F 15 . The estimating function F 15  of the watermarking information estimates and detects the watermarking information by searching the peak of the mutual correlation value while phase shift is carried out as shown in  FIGS. 9 and 10 . When the variation of the correlation value is viewed, a peak appears at some phase shift amount, and the polarity of this peak represents the watermarking information  102 .  
         [0000]     (6) Hardware Construction of Digital Watermarking Detecting Device  
         [0136]     The digital watermarking detecting device can be also implemented by using a general-purpose computer device  1  shown in  FIG. 19  as basic hardware.  
         [0137]     That is the extracting function, the first orthogonal transformation function, the amplitude adjusting function, the composition function, the second orthogonal transformation function and the estimating function can be implemented by making a processor  2  installed in the computer device execute a program.  
         [0138]     At this time, the digital watermarking detecting device may be implemented by installing the above program in a storage device  3  such as the memory of the computer device, a hard disc or the like in advance, or achieved by storing the program in a recording medium  5  such as CD-ROM or the like and achieving the program from a storage medium reading device  4 , or implemented by distributing the program through a network and properly installing the program from a communication device  6  into the computer device.  
         [0139]     Furthermore, the watermarking embedded image signal may be achieved by properly utilizing the storage device  3  such as a memory installed in or externally provided to the computer device  1  a hand disk or the storage medium  5  such as CD-R, CD-RW, DVD-RAM, DVD-R or the like. Furthermore, the watermarking embedded image signal may be achieved from other devices (for example, a computer, a server, etc.) connected to the network through the communication device  6 .  
       Second Embodiment  
       [0140]     A digital watermarking embedding device and a digital watermarking detecting device according to a second embodiment of the present invention will be described.  
         [0000]     (Digital Watermarking Embedding Device)  
         [0141]     First, the digital watermarking embedding device according to the second embodiment will be described with reference to  FIGS. 8 and 9 .  
         [0142]      FIG. 8  is a block diagram showing the basic construction of the digital watermarking embedding device.  
         [0143]     In the digital watermaking embedding device, a digitalized image signal of a motion picture or still picture is input as an embedding target image  103  corresponding to an image in which watermarking information should be embedded. The embedding target image signal  103  may contain both a brightness signal and a color difference signal, or it may containonly the brightness signal. The embedding target image signal  103  is branched into three parts, and they are input to an enlarging/reducing unit  16 , a feature amount extractor  21  and a watermarking information superposing portion  23 .  
         [0144]     The enlarging/reducing unit  16  comprises a digital filter having a frequency band, and generates an enlarged/reduced component having a specific scaling rate, for example, a magnifying power of 0.5 from the embedding target image signal  103 . In the following description, the output signal from the enlarging/reducing unit  16  will be referred to as “enlarged/reduced signal”. The enlarged/reduced signal output from the enlarging/reducing unit  16  is input to the specific frequency component extractor  20 .  
         [0145]     The specific frequency component extractor  20  comprises a digital filter having a frequency band, for example, a low pass filter or high pass filter that has a predetermined cut-off frequency, or a band pass filter having a predetermined passband center frequency, and extracts a specific frequency component, for example, a relatively high frequency component from the embedding target image signal  103 . In the following description, the output signal from the specific frequency component extractor  20  will be referred to as “specific frequency component signal”.  
         [0146]     The specific frequency component signal output from the specific frequency component extractor  20  is converted in phase and amplitude by the phase and amplitude converter  22 . Here, only the phase may be converted or only the amplitude may be converted. Watermarking information  102  corresponding to digital information to be embedded in the embedding target image signal  103  is supplied to the phase and amplitude converter  22 .  
         [0147]     The phase and amplitude converter  22  is designed so as to subject a specific frequency component signal to phase conversion of a predetermined inherent phase conversion amount and amplitude conversion of a predetermined inherent amplitude conversion amount. Specifically, the phase conversion of the phase and amplitude converter  22  is implemented by a single or plural digital phase shifters, and the phase conversion amount corresponds to the phase shift amount of the phase shifters.  FIG. 9  is a diagram showing the aspect of the phase shift by a phase converter  112 . In this case, the specific frequency component signal is simply phase-shifted while keeping the waveform thereof. Specifically, the amplitude conversion of the phase and amplitude converter  22  comprises a single or plural exclusive OR circuits or digital multipliers, and the amplitude conversion amount is an efficient to be multiplied to the specific frequency component signal to be input. The watermarking information  102  is input to the phase and amplitude converter  22 , and the phase conversion amount (phase shift amount) of the phase and amplitude converter  22  and the amplitude conversion amount (coefficient) are controlled according to the watermarking information  102 .  
         [0148]     Furthermore, the feature amount of the embedding target image signal  103 , for example, activity representing the complexity degree of an image by the feature amount extractor  21 . The information on the feature amount is input to the phase and amplitude converter  22 . In the phase and amplitude converter  22 , the phase conversion amount (phase shift amount) and the amplitude conversion amount (coefficient) are controlled in accordance with the feature amount thus input. The feature amount extractor  21  is not indispensable and it may be omitted.  
         [0149]     The specific frequency component signal that is subjected to phase conversion and amplitude conversion by the phase and amplitude converter  22  is supplied as an embedding signal by a watermarking information superposing portion  23  comprising a digital adder, and superposed on the embedding target image signal  103 . That is, the specific frequency component signal extracted by the enlarging/reducing unit  16 /the specific frequency component extractor  20  is subjected to phase conversion and amplitude conversion inherent to the digital watermarking embedding device by the phase and amplitude converter  22 , and also one or both of the phase conversion and the amplitude conversion amount are controlled by the watermarking information  102 , and a watermarking embedded image  101  in which the watermarking information  102  is embedded in the embedding target image signal  103  is generated in the watermarking information superposing portion  23 .  
         [0150]     The specific frequency component signal which is extracted by the specific frequency component extractor  20  and converted in phase and amplitude by the phase and amplitude converter  22  may exist over plural channels. In this case, the specific frequency component signals of the plural channels are superposed on the embedding target image signal  103  in the watermarking information superposing portion  23 .  
         [0151]     The watermarking embedded image signal  101  corresponding to the image signal embedded with the watermarking information as described above is recorded by a digital image recording and reproducing device such as a DVD system or the like, or transmitted through a transmission medium such as the Internet, a broadcast satellite, a communication satellite or the like.  
         [0000]     (Digital Watermarking Detecting Device)  
         [0152]     An embodiment of a digital watermarking detecting device when the watermarking embedded image signal  101  is detected will be described hereunder with reference to the drawings.  
         [0153]     The digital watermarking detecting device according to the second embodiment will be described with reference to  FIGS. 2, 4 ,  6 ,  9  to  11  and  19 .  
         [0000]     (1) Construction of Digital Watermarking Detecting Device  
         [0154]      FIG. 2  shows the construction of the digital watermaking embedding device according to this embodiment.  
         [0155]     A watermarking embedded image signal  101  in which a specific frequency component signal is controlled and embedded according to watermarking information  102  by the digital watermarking embedding device described above is input to the digital watermarking detecting device of  FIG. 2  through a recording medium or transmission medium. It is assumed that a digital signal of “ 1 ” or “ 0 ” is embedded as the watermarking information.  
         [0156]     The watermarking embedded image signal  101  is enlarged/reduced at the same scaling rate as used in the digital watermarking embedding device described above by the enlarging/reducing unit  16 . Only a specific component is extracted from the enlarged/reduced signal by the extractor  10 . The extractor comprises a digital filter having the same frequency area as the specific frequency component extractor used in the digital watermarking embedding device, for example, a low pass filter or high pass filter that has a predetermined cut-off frequency, or a band pass filter having a predetermined passband center frequency, and it extracts an extraction signal of a specific frequency component, for example, a relatively high frequency component from the watermarking embedded image signal  101 .  
         [0157]     The extraction signal extracted by the extractor  10  is subjected to orthogonal transformation processing such as orthogonal transformation or the like by the first orthogonal transformer  11 A, and the watermarking embedded image signal  101  is subjected to orthogonal transformation processing such as orthogonal transformation or the like by the first orthogonal transformer  11 B. There may be also considered such a situation that the extractor extracts all the frequency components.  
         [0158]     The amplitude component of the first orthogonal transformer  11 A is adjusted in amplitude by the amplitude adjuster  12 A so that the difference thereof from the amplitude component of the first orthogonal transformer  11 B is suppressed to a predetermined range, and likewise the amplitude component of the first orthogonal transformer  11 B is adjusted in amplitude by the amplitude adjuster  12 B so as to approach to the amplitude component of the first orthogonal converter  11 A.  
         [0159]     The two signals after the amplitude adjustment are subjected to complex composition by the compositor  13 .  
         [0160]     The composite signal after the complex composition is subjected to orthogonal transformation or inverse orthogonal transformation by the second orthogonal transformer  14 . The orthogonal transformation at this time is required to be paired with the transformation in the first orthogonal transformation, and when Fourier Transform is used in the first orthogonal transformation, Fourier Transform or inverse Fourier Transform is used in the second orthogonal transformation.  
         [0161]     The composite signal after the second orthogonal transformation is supplied to the input of the estimator  15 . A method of the estimator  15  estimating the watermarking information  102  from the composite signal after the transformation will be described with reference to  FIGS. 9 and 10 . A digital signal of “ 1 ” or “ 0 ” is embedded as the watermarking information described above.  
         [0162]     As shown in  FIG. 9 , the correlation between the composite signal after the transformation and the original non-phase-shifted composite signal after the transformation is taken while the composite signal concerned is phase-shifted. The relationship between the mutual correlation value and the phase shift amount is shown in  FIG. 10 .  
         [0163]     As shown in  FIG. 10 , when variation of the mutual correlation value is observed, a peak appears at the position of some phase shift amount, and the polarity of the peak represents the watermarking information  102 . For example,when the watermarking embedded image signal  101  is suffering a scaling attack, the phase shift amount of the specific frequency component signal thus attacked is made different from the phase shift amount given to the specific frequency component signal in the digital watermarking embedding device.  
         [0164]     Therefore, in this embodiment, the phase shift amount is continuously or stepwise controlled by the estimator  15 , a peak of the mutual correlation value output in connection with the above control is searched, and the watermarking information is estimated and detected on the basis of the polarity of the peak thus searched. The peak of the mutual correlation value takes one of positive and negative values in accordance with the value of the watermarking information. For example, in the case of  FIG. 10 , when the peak has a positive value, the watermarking information is judged as “ 1 ”. When the peak has a negative value, the watermarking information is judged as “ 0 ”. As described above, for the image suffering the scaling attack, the watermarking information  102  detected by the estimator  15  is output.  
         [0165]     As described above, according to this embodiment, the extraction signal is extracted from the signal achieved by enlarging/reducing the watermarking embedded image signal, and the watermarking information is detected from the correlation result of the phase restricted correlation between the extraction signal and the watermarking embedded image signal through the mutual correlation. In this case, the correlation calculation is carried out while varying the phase, whereby the peak of the correlation value can be searched. Therefore, the watermarking information can easily be detected from the embedded image signal suffering the scaling attack as well.  
         [0166]     Here, the same amplitude adjusting method as described with respect to the first embodiment can be used as the amplitude adjusting unit of the phase restricted correlation.  
         [0000]     (2) Procedure of Digital Watermarking Detecting Method  
         [0167]     The procedure of the digital watermarking detecting method according to this embodiment will be described with reference to the flowchart of  FIG. 4 .  
         [0168]     In enlarging/reducing step S 16 , a watermarking embedded image signal  101  is enlarged/reduced in the same scaling rate as used in the digital watermarking embedding device described above. Only a specific component is extracted from the enlarged/reduced signal in extraction step S 10 . Only the specific frequency component is extracted in the extraction step S 10 . This extraction step is a digital filter having the same frequency band as the specific frequency component extractor used in the digital watermarking embedding operation which is paired with the extraction step.  
         [0169]     The extraction signal extracted by the extraction step S 10  is subjected to orthogonal transformation processing such as Fourier Transform or the like by a first orthogonal transformation step S 11 B. The watermarking embedded image signal  101  is subjected to orthogonal transformation processing such as Fourier Transform or the like by a first orthogonal transformation step S 11 A. The amplitude component of the first orthogonal transformation step S 11 A is adjusted in amplitude by an amplitude adjusting step S 12 A so that the difference thereof from the amplitude component of the first orthogonal transformation step S 11 B is suppressed to a predetermined range, and likewise the amplitude component of the first orthogonal transformation step S 11 B is adjusted in amplitude by an amplitude adjusting step S 12 B so as to approach to the amplitude component of the first orthogonal transformation step S 11 A.  
         [0170]     The two signals after the amplitude adjustment are subjected to complex composition by the composition step S 13 .  
         [0171]     The signal after the complex composition is subjected to orthogonal transformation or inverse orthogonal transformation by the second orthogonal transformation step S 14 . The orthogonal transformation at this time is required to be paired with the orthogonal transformation in the first orthogonal transformation. When Fourier Transform is used in the first orthogonal transformation, Fourier Transform or inverse Fourier Transform is used in the second orthogonal transformation.  
         [0172]     The data after the second orthogonal transformation are supplied to the input of the estimating step S 15 . The estimating step S 15  of the watermarking information estimates and detects watermarking information by searching the peak of the mutual correlation value while shifting the phase as shown in  FIGS. 9 and 10 . When the variation of the correlation value is viewed, a peak appears at some phase shift amount, and the polarity of the peak represents the watermarking information  102 .  
         [0000]     (3) Construction of Digital Watermarking Detecting Program  
         [0173]     Next, the construction of a digital watermarking detecting program according to this embodiment will be described with reference to  FIG. 6 .  
         [0174]     The watermarking embedded image signal  101  is enlarged/reduced in the same scaling rate as used in the digital watermarking embedding device described above by an enlarging/reducing function F 16 . Only a specific component is extracted from the enlarged/reduced signal by the extracting function a F 10 . Only a specific frequency component is extracted by the extracting function F 10 . The extracting function is a digital filter having the same frequency band as the specific frequency component extracting function used in the digital watermarking embedding operation which is paired with the extracting function.  
         [0175]     The extraction signal extracted by the extracting function F 10  is subjected to orthogonal transformation processing such as Fourier Transform or the like by the first orthogonal transformation function F 11 B. The watermarking embedded image signal  101  is subjected to orthogonal transformation processing such as Fourier Transform or the like by the first orthogonal transformation function F 11 A.  
         [0176]     The amplitude component of the first orthogonal transformation function F 11 A is adjusted in amplitude by the amplitude adjusting function F 12 A so that the difference thereof from the amplitude component of the first orthogonal transformation function F 11 B is suppressed to a predetermined range, and likewise the amplitude component of the first orthogonal transformation function F 11 B is adjusted in amplitude by the amplitude adjusting function F 12 B so as to approach to the amplitude component of the first orthogonal transformation function F 11 A.  
         [0177]     The two signals after the amplitude adjustment are subjected to complex composition by the composition function F 13 .  
         [0178]     The signal after the complex composition is subjected to orthogonal transformation or inverse orthogonal transformation by the second orthogonal transformation function F 14 . The orthogonal transformation at this time is required to be paired with the transformation in the first orthogonal transformation, and when Fourier Transform is used in the first orthogonal transformation, Fourier Transform or inverse Fourier Transform is used in the second orthogonal transformation.  
         [0179]     The data after the second orthogonal transformation is supplied to the input of the estimating function F 15 . The estimating function F 15  of the watermarking information estimates and detects the watermarking information by searching the peak of the mutual correlation value while shifting the phase as shown in  FIGS. 9 and 10 . When the variation of the correlation value is viewed, a peak appears at some phase shift amount, and the polarity of this peak represents the watermarking information  102 .  
         [0000]     (4) Hardware Construction of Digital Watermarking Detecting Device  
         [0180]     The digital watermarking detecting device of this embodiment may be implemented by using a general-purpose computer device  1  shown in  FIG. 19  as basic hardware as in the case of the first embodiment.  
         [0000]     [Modification] 
         [0181]     The present invention is not limited to the above-described embodiments, and various modifications and alterations may be made without departing from the subject matter of the present invention. Furthermore, plural constituent elements disclosed in the above embodiments may be properly combined to implement the present invention. For example, some constituent elements may be deleted from all the constituent elements disclosed in the above embodiments. Furthermore, constituent elements of different embodiments may be properly combined.  
       INDUSTRIAL APPLICABILITY  
       [0182]     The present invention is suitably applicable to a device for recording and reproducing digital image data such as a digital VTR, DVD or the like.