how to perform multi label evaluation?

#2
by fcakyon - opened

Assume I have more than 1 true label per image or video. How to calculate multi-label F1 using this module?

Evaluate Metric org
edited Jul 29, 2022

Hi @fcakyon , the following should work:

f1 = evaluate.load("f1", "multilabel")

f1.compute(
    predictions=[[0, 1, 1], [1, 1, 0]],
    references=[[0, 1, 1], [0, 1, 0]],
    average="macro"
)

Sign up or log in to comment