---
title: Shopping MMLU Leaderboard
emoji: 🌎
colorFrom: blue
colorTo: green
sdk: gradio
sdk_version: 4.44.1
app_file: app.py
pinned: true
license: apache-2.0
tags:
- leaderboard
short_description: 'Massive Multi-Task LLM Benchmark for Online Shopping'
---


In this leaderboard, we display evaluation results obtained with Shopping MMLU. The space provides an overall leaderboard, consisting of 4 main online shopping skills:
- Shopping Concept Understanding
- Shopping Knowledge Reasoning
- User Behavior Alignment
- Multi-lingual Abilities  

Github: https://github.com/KL4805/ShoppingMMLU
Report: https://arxiv.org/abs/2410.20745

Please consider to cite the report if the resource is useful to your research:

```BibTex

```