A method of processing a multimedia signal by an apparatus, the method comprising: obtaining a video frame and an audio frame from the multimedia signal; and obtaining a plurality of video objects from the video frame and at least one audio object from the audio frame; characterized in that the method further comprises: obtaining feature information by performing a feature extraction on the plurality of video objects and the at least one audio object; determining a correlation between each of the plurality of video objects and each of the at least one audio object by an object matching engine based on the obtained feature information, wherein the correlation between a video object and an audio object is a real number value expressing a degree of relationship between the video object and the audio object; and performing a directional rendering on a specific audio object of the at least one audio object based on a screen location of a specific video object, wherein the specific video object is a video object of the plurality of video objects which is determined, from among the plurality of video objects, as the video object related to the specific audio object, according to the determined correlation between the video object and the specific audio object. obtaining a video frame and an audio frame from the multimedia signal; and obtaining a plurality of video objects from the video frame and at least one audio object from the audio frame; characterized in that the method further comprises: obtaining feature information by performing a feature extraction on the plurality of video objects and the at least one audio object; determining a correlation between each of the plurality of video objects and each of the at least one audio object by an object matching engine based on the obtained feature information, wherein the correlation between a video object and an audio object is a real number value expressing a degree of relationship between the video object and the audio object; and performing a directional rendering on a specific audio object of the at least one audio object based on a screen location of a specific video object, wherein the specific video object is a video object of the plurality of video objects which is determined, from among the plurality of video objects, as the video object related to the specific audio object, according to the determined correlation between the video object and the specific audio object. obtaining feature information by performing a feature extraction on the plurality of video objects and the at least one audio object; determining a correlation between each of the plurality of video objects and each of the at least one audio object by an object matching engine based on the obtained feature information, wherein the correlation between a video object and an audio object is a real number value expressing a degree of relationship between the video object and the audio object; and performing a directional rendering on a specific audio object of the at least one audio object based on a screen location of a specific video object, wherein the specific video object is a video object of the plurality of video objects which is determined, from among the plurality of video objects, as the video object related to the specific audio object, according to the determined correlation between the video object and the specific audio object.