Hugging Face's logo
Arka Pal's picture
27 1

Arka Pal

ArkaAbacus
manleyroberts's profile picture 21world's profile picture Kutches's profile picture
·

AI & ML interests

None yet

Organizations

LiveBench's profile picture

ArkaAbacus's activity

New activity in open-llm-leaderboard/open_llm_leaderboard 5 months ago

Models disappearing from eval queue?

7
#805 opened 5 months ago by ArkaAbacus
New activity in abacusai/Llama-3-Smaug-8B 5 months ago

Any news about the updated model with the latest recipe?

2
#5 opened 6 months ago by ManniX-ITA
New activity in open-llm-leaderboard/open_llm_leaderboard 6 months ago

GSM8K Evaluation has a serious bug/oversight, that is negatively impacting score of all Llama 3 models. Please consider updating to the latest commit of lm-evaluation-harness which fixes it.

3
#770 opened 6 months ago by ArkaAbacus
New activity in abacusai/Smaug-Llama-3-70B-Instruct 7 months ago

Smaug-LLaMa-3-8B-Instruct in the works?

4
#3 opened 7 months ago by Joseph717171

Use correct license - llama3 instead of llama2

1
#1 opened 7 months ago by ddh0

Prompt format?

1
#2 opened 7 months ago by ddh0
New activity in abacusai/Llama-3-Giraffe-70B 7 months ago

base model

3
#2 opened 7 months ago by ehartford

prompt? llama-3?

1
#1 opened 7 months ago by bdambrosio
New activity in abacusai/Llama-3-Smaug-8B 8 months ago

What datasets were these trained on?

5
#2 opened 8 months ago by rombodawg
New activity in meta-llama/Meta-Llama-3-70B-Instruct 8 months ago

Fix chat template to add generation prompt only if the option is selected

1
#6 opened 8 months ago by ArkaAbacus

Fix chat template to add generation prompt only if the option is selected.
#4 opened 8 months ago by ArkaAbacus
New activity in meta-llama/Meta-Llama-3-8B-Instruct 8 months ago

Fix chat template to add generation prompt only if the option is selected

1
#9 opened 8 months ago by ArkaAbacus

Fix chat template to add generation prompt only if the option is selected
#8 opened 8 months ago by ArkaAbacus

Fix chat template to add generation prompt only if the option is selected
#7 opened 8 months ago by ArkaAbacus

Fix chat template to add generation prompt only if the option is selected
#6 opened 8 months ago by ArkaAbacus
New activity in mistralai/Mixtral-8x22B-Instruct-v0.1 8 months ago

Isn't it necessary to also include tokenizer.model?

2
#14 opened 8 months ago by ArkaAbacus
New activity in abacusai/Smaug-72B-v0.1 8 months ago

aaa

1
#25 opened 8 months ago by liyon
New activity in abacusai/Smaug-2-72B 8 months ago

What is this?

1
#1 opened 8 months ago by bdambrosio
New activity in data-is-better-together/10k_prompts_ranked 9 months ago

Dataset error on generation

2
#8 opened 9 months ago by ArkaAbacus
New activity in abacusai/ARC_DPO_FewShot 9 months ago

Unexpected error in the dataset!

1
#1 opened 9 months ago by rbgo