`affinity` is more like a similarity measure. Should the option name be changed? CC @ogrisel @AlexanderFabisch