The 21st International Society for Music Information Retrieval Conference (ISMIR 2020)

Analysis of Song/Artist Latent Features and Its Application for Song Search
Kosetsu Tsukuda and Mastaka Goto

National Institute of Advanced Industrial Science and Technology (AIST)

1 Embed song/artist vectors into the same feature space

3 Application examples

In music recommendation, artists and songs are represented by latent vectors

Familiarity-oriented search

The vectors are usually used only to compute a user’s preference toward a songWe embed song/artist vectors in the same feature space to leverage the vectors

Play logs

Factorization Machines𝑥𝑥�𝑢𝑢𝑢𝑢 = 𝛼𝛼 + 𝛽𝛽𝑢𝑢 + 𝛽𝛽𝑠𝑠 + 𝛽𝛽𝑎𝑎 𝑠𝑠+ 𝝂𝝂𝑢𝑢 , 𝝂𝝂𝑠𝑠 + 𝝂𝝂𝑢𝑢 , 𝝂𝝂𝑎𝑎𝑠𝑠 + 𝝂𝝂𝑎𝑎𝑠𝑠 , 𝝂𝝂𝑠𝑠
𝑢𝑢: user, 𝑠𝑠: song, 𝑎𝑎𝑠𝑠 : artist of 𝑠𝑠𝛼𝛼, 𝛽𝛽𝑢𝑢 , 𝛽𝛽𝑠𝑠 , 𝛽𝛽𝑎𝑎𝑠𝑠 : bias terms
𝝂𝝂𝑢𝑢 , 𝝂𝝂𝑠𝑠 , 𝝂𝝂𝑎𝑎𝑠𝑠 : latent vectors

k-dimensional
latent vectors

𝑠𝑠1 𝑠𝑠2 𝑠𝑠3…

𝑎𝑎1 𝑎𝑎2 𝑎𝑎3…

k-dimensionalfeature space

Embed

𝑠𝑠1

𝑎𝑎3

𝑎𝑎1

𝑎𝑎1

𝑠𝑠2

𝑠𝑠3

2 Overall similarity (OS) and prominent affinity (PA)Overall similarity
𝑠𝑠1𝑎𝑎1𝟎𝟎

𝑠𝑠1𝑎𝑎3 𝑎𝑎1

When a song is fairly close to an artist,
the song is similar overall to the artist
Overall similarity is defined by thecloseness between an artist and a song
Artist: The Beatles
RankSong
1
I’m So Tired2
Get Back
3
The End4
Sun King
5Here Comes the Sun

𝑎𝑎1

𝑠𝑠2

𝑠𝑠3

Prominent affinity

𝟎𝟎

𝑎𝑎1

𝑠𝑠3

When a song is fairly close to the extended
position of an artist, the song prominentlyrepresents the artist’s characteristics
Prominent affinity is defined by theinner product of an artist and a song
Artist: The BeatlesRankSong
1Something
2
All You Need Is Love
3
Come Together
4
Hey Jude5
I Am the Walrus

Which song represents
Lady Gaga’s typicalcharacteristics well?

What are unexpectedsongs of The Black Keys?

for realizing new song search applications

BLow
PA

High popularity- Gold on the Ceiling- Lonely Boy- Can’t Fine My Mind
- Howling For You- Yearnin’- Grown So Ugly

DLow popularity

Query: Lady GagaA- Same Old Thing- I Got MineCTypicality-oriented searchHighPARankSong by OS
1
California Curls / Katy Perry2
Racy Lacey / Girls Aloud3
Gimme More / Britney Spears
4Cannibal / Ke$ha
5
Piece of Me / Britney Spears

Analogy search
What Aerosmith songcorresponds to That Means
A Lot by The Beatles?
Query
Source artist
The Beatles
Source song That Means A Lot
Target artist
Aerosmith
Rank
1
2
3

Song
Milk Cow Blues
FaceTemperatureA: for users who are notGiven artist 𝑎𝑎, all songs in thefamiliar with the artist
dataset can be ranked in terms Search for the target artist’s songs
B: for users who want toof OS or PA
that have a similar relationshipknow the artist’s diversity By showing such songs to a
between the source artist andC: for users who want tothe source songuser who is a fan of Lady Gaga,
C: listen to unexpected songs
she may be willing to listen to The similarity is defined by theD: for users who want tounfamiliar songs because theyangle between vectors and the
D: become an artist devotee
are highly related to Lady Gaga ratio of vector lengths

4 Contributions
Propose the concepts of overall similarity and prominent affinity
Relationships between songs and artists in a latent feature space

Show characteristics of overall similarity and prominent affinity
Latent vectors are generated by using Last.fm play logs for two years

Demonstrate three applications for music information retrieval
Familiarity-oriented search, typicality-oriented search, and analogy search

We want other researchers toleverage our proposed concepts
and realize useful music
information retrieval systems