A method of processing a multimedia signal by an apparatus, the method comprising: obtaining at least one video object from the multimedia signal and at least one audio object from the multimedia signal; extracting video feature information for the at least one video object and audio feature information for the at least one audio object; and determining a correlation between the at least one video object and the at least one audio object through an object matching engine based on the video feature information and the audio feature information, wherein the video feature information comprises a feature value extracted based on: a ratio between a distance between a top boundary of a first rectangular region including a face and a top boundary of a second rectangular region including lips within the first rectangular region, a height of the second rectangular region, and a distance between a bottom boundary of the second rectangular region and a bottom boundary of the first rectangular region; and a ratio between a distance between a left boundary of the second rectangular region and a left boundary of the first rectangular region, a width of the second rectangular region, and a distance between a right boundary of the second rectangular region and a right boundary of the first rectangular region; and wherein the first rectangular region is a face box, and the second rectangular region includes a lip skeleton. obtaining at least one video object from the multimedia signal and at least one audio object from the multimedia signal; extracting video feature information for the at least one video object and audio feature information for the at least one audio object; and determining a correlation between the at least one video object and the at least one audio object through an object matching engine based on the video feature information and the audio feature information, wherein the video feature information comprises a feature value extracted based on: a ratio between a distance between a top boundary of a first rectangular region including a face and a top boundary of a second rectangular region including lips within the first rectangular region, a height of the second rectangular region, and a distance between a bottom boundary of the second rectangular region and a bottom boundary of the first rectangular region; and a ratio between a distance between a left boundary of the second rectangular region and a left boundary of the first rectangular region, a width of the second rectangular region, and a distance between a right boundary of the second rectangular region and a right boundary of the first rectangular region; and wherein the first rectangular region is a face box, and the second rectangular region includes a lip skeleton. a ratio between a distance between a top boundary of a first rectangular region including a face and a top boundary of a second rectangular region including lips within the first rectangular region, a height of the second rectangular region, and a distance between a bottom boundary of the second rectangular region and a bottom boundary of the first rectangular region; and a ratio between a distance between a left boundary of the second rectangular region and a left boundary of the first rectangular region, a width of the second rectangular region, and a distance between a right boundary of the second rectangular region and a right boundary of the first rectangular region; and wherein the first rectangular region is a face box, and the second rectangular region includes a lip skeleton.