A method of processing a multimedia signal by an apparatus, the method comprising: obtaining (S106) at least one video object from the multimedia signal and at least one audio object from the multimedia signal; extracting (S110) video feature information for the at least one video object and audio feature information for the at least one audio object; and determining (S112) a correlation between the at least one video object and the at least one audio object through an object matching engine based on the video feature information and the audio feature information, wherein the video feature information comprises a feature value extracted based on: a ratio between a distance (A) between a top boundary of a first rectangular region including a face and a top boundary of a second rectangular region including lips within the first rectangular region, a height (B) of the second rectangular region, and a distance (C) between a bottom boundary of the second rectangular region and a bottom boundary of the first rectangular region; and a ratio between a distance (D) between a left boundary of the second rectangular region and a left boundary of the first rectangular region, a width (E) of the second rectangular region, and a distance (F) between a right boundary of the second rectangular region and a right boundary of the first rectangular region; and wherein the first rectangular region is a face box, and the second rectangular region includes a lip skeleton. obtaining (S106) at least one video object from the multimedia signal and at least one audio object from the multimedia signal; extracting (S110) video feature information for the at least one video object and audio feature information for the at least one audio object; and determining (S112) a correlation between the at least one video object and the at least one audio object through an object matching engine based on the video feature information and the audio feature information, wherein the video feature information comprises a feature value extracted based on: a ratio between a distance (A) between a top boundary of a first rectangular region including a face and a top boundary of a second rectangular region including lips within the first rectangular region, a height (B) of the second rectangular region, and a distance (C) between a bottom boundary of the second rectangular region and a bottom boundary of the first rectangular region; and a ratio between a distance (D) between a left boundary of the second rectangular region and a left boundary of the first rectangular region, a width (E) of the second rectangular region, and a distance (F) between a right boundary of the second rectangular region and a right boundary of the first rectangular region; and wherein the first rectangular region is a face box, and the second rectangular region includes a lip skeleton. a ratio between a distance (A) between a top boundary of a first rectangular region including a face and a top boundary of a second rectangular region including lips within the first rectangular region, a height (B) of the second rectangular region, and a distance (C) between a bottom boundary of the second rectangular region and a bottom boundary of the first rectangular region; and a ratio between a distance (D) between a left boundary of the second rectangular region and a left boundary of the first rectangular region, a width (E) of the second rectangular region, and a distance (F) between a right boundary of the second rectangular region and a right boundary of the first rectangular region; and wherein the first rectangular region is a face box, and the second rectangular region includes a lip skeleton. <EOS>