metadata
license: apache-2.0
Model Card for MediaTek Research Breeze-7B-FC-v1_0
Function Calling Performance
Berkeley function-calling leaderboard (EN)
| Models | #Parameters | License | ↑ Overall | Relevance Detection |
AST/ Simple |
AST/ Multiple |
AST/ Parallel |
AST/ Parallel-Multiple |
Exec/ Simple |
Exec/ Multiple |
Exec/ Parallel |
Exec/ Parallel-Multiple |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Breeze-7B-FC-v1_0 (FC) | 7B | Apache 2.0 | 86.01 | 74.58 | 90.00 | 93.00 | 82.00 | 83.00 | 98.00 | 92.00 | 88.00 | 75.00 |
| GPT-3.5-Turbo-0125 (FC) | Proprietary | 72.77 | 4.58 | 87.75 | 90.50 | 88.50 | 82.50 | 91.00 | 82.00 | 78.00 | 52.50 |