Patent ID: 8504422

Claim:
A method performed under control of one or more processors configured with executable instructions, the method comprising: ranking a plurality of musical passages for relevance to a photo album, the ranking utilizing text-based metadata associated with the plurality of musical passages and the photo album; mapping the musical passages and at least one photo from the photo album to a style and mood ontology, each mapping obtaining a vector-based representation of the mapped musical passage or photo with respect to the style and mood ontology; re-ranking, by the one or more processors, the musical passages for relevance to the photo album using input from both the ranking and the mapping, the re-ranking generating a relevancy term for each musical passage to the photo album by calculating, for each musical passage of the plurality of musical passages, a relevance term R=w 1 r 1 +w 2 r 2 , wherein: w 1 and w 2 are scalars used to weight r 1 and r 2 , w 1 +w 2 =1, 0<=w 1 <=1, and 0<=w 2<= 1; r 1 is a scalar representing relevance obtained from ranking musical passages for relevance; r 2 is a scalar representing relevance obtained from the mapping, r 2 =1−d(v 1 ,v 2 ); v 1 is a vector representing a mapping of the at least one photo; and v 2 is a vector representing a mapping of a musical passage; and selecting, based at least in part on the generated relevancy terms, a musical passage to be played during sequential display of a plurality of photos of the photo album on a user interface.