Top3 Accuracy = 1; epoch = 3

Evaluation Results (Regional Datasets)

Dataset Top-1 Top-2 Top-3 Top-4 Top-5 Top-6 Top-7 Top-8 Top-9 Top-10 Top-11 Top-12 F1 Macro F1 Weighted
Afrobarometer 50.37% 68.75% 75.74% 79.78% 83.82% 85.66% 87.87% 92.28% 93.75% 97.06% 97.79% 100% 0.3070 0.4950
CGSS 33.75% 50.79% 66.56% 74.13% 81.07% 85.49% 89.27% 91.17% 94.01% 96.53% 98.11% 100% 0.2480 0.3593
EVS 43.15% 55.60% 66.80% 73.86% 82.99% 90.04% 94.61% 96.27% 97.51% 99.17% 99.59% 100% 0.3485 0.4256
GSS 45.45% 66.67% 77.65% 85.23% 89.02% 93.56% 95.08% 95.83% 98.48% 99.24% 100.00% 100% 0.3636 0.4749
ISD 54.39% 70.71% 79.50% 87.45% 92.47% 94.14% 95.40% 97.49% 97.49% 99.16% 100.00% 100% 0.2799 0.6121
LAPOP 43.96% 65.77% 73.49% 78.86% 83.89% 87.58% 91.28% 93.96% 96.98% 97.99% 98.99% 100% 0.3146 0.4296

Note:

  • Afrobarometer: Africa, CGSS: China, EVS: Europe, GSS: USA, ISD: International Social Survey, LAPOP: Latin America.
Downloads last month
2
Safetensors
Model size
2B params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support