Iftach Arbel

iarbel

AI & ML interests

Optimization Algorithms, NLP, LLMs, CV

Recent Activity

Organizations

Project Didi's profile picture Neradot ltd's profile picture Design Like You Mean It's profile picture

iarbel's activity

published a Space 29 days ago
New activity in cimphony-ai-admin/Cimphony-Mistral-Law-7B 6 months ago

Fail to run on vLLM

5
#1 opened 7 months ago by
yaronr
replied to DmitryRyumin's post 11 months ago
view reply

The evaluation benchmarks use zero-shot, where usually few-shot is used. This raises the question whether the few-shot results weren't as good, compared to similar-sized models.

Hopefully the authors will release few-shot results, aligned with common practice (e.g. HF Open LLM Leaderboard)

updated a Space about 1 year ago