Hugging Face's logo
Lewis Tunstall's picture
1117 51 465

Lewis Tunstall PRO

lewtun
DesmondChoy's profile picture portionofspace's profile picture avip7's profile picture
·
https://lewtun.github.io/blog/
_lewtun
lewtun

AI & ML interests

LLMs, LLMs, LLMs

Articles

Organizations

Hugging Face's profile picture AutoNLP's profile picture Natural Language Processing with Transformers's profile picture BigScience Workshop's profile picture Ought's profile picture Hugging Face Internal Testing Organization's profile picture Testing Benchmarks on the Hub's profile picture Hugging Face Course's profile picture NLP en ES's profile picture GEM benchmark's profile picture SetFit's profile picture Benchmarks Hosting's profile picture GEM benchmark submissions's profile picture ALPS test's profile picture Deep Learning for Particle Physicists's profile picture fast.ai community's profile picture Somos NLP's profile picture HF Course Demos's profile picture Marsyas (Music Analysis, Retrieval and Synthesis for Audio Signals)'s profile picture ONNXConfig for all's profile picture How to teach Hugging Face?'s profile picture Jet Universe's profile picture Evaluation on the Hub's profile picture The ML Landscape of Top Taggers's profile picture HuggingFaceM4's profile picture HF Canonical Model Maintainers's profile picture BigCode's profile picture Inference Endpoints's profile picture BigCode Data's profile picture Reading Group's profile picture DreamBooth Hackathon's profile picture trl internal testing's profile picture Hugging Face H4's profile picture TRL's profile picture Evaluation datasets's profile picture Hugging Face H4 Community's profile picture Open LLM Leaderboard's profile picture Hugging Face Smol Cluster's profile picture EPFL LLM Team's profile picture H4 Alignment Handbook's profile picture ZeroGPU Explorers's profile picture Kato's profile picture Project-Numina's profile picture h4-argilla-collab's profile picture ORPO Explorers's profile picture

lewtun's activity

New activity in HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1 about 1 month ago

35B is not the right number of Active parameters

1
#9 opened about 1 month ago by kyo-takano

Fix active number of params in model card

1
#13 opened about 1 month ago by lewtun

Update config.json

1
#11 opened about 1 month ago by sugatoray

Context window?

1
#10 opened about 1 month ago by oliviermills
New activity in HuggingFaceH4/orca_dpo_pairs about 1 month ago

Add dpo tag

1
#4 opened about 1 month ago by davanstrien
New activity in HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1 about 1 month ago

Trained with chatgpt outputs

4
#8 opened about 1 month ago by SilentWraith

Token indices sequence length is longer than the specified maximum sequence length for this model (4645 > 2048)

4
#5 opened about 1 month ago by Maverick17

Add sampling parameters for widget
#7 opened about 1 month ago by lewtun

Prompt format

6
#4 opened about 1 month ago by sam-paech
New activity in mistral-community/Mixtral-8x22B-v0.1 about 1 month ago

How many active parameters does this model have?

3
#6 opened about 1 month ago by lewtun

Benchmarks are here!

26
#4 opened about 1 month ago by 0-hero
New activity in 0-hero/prompt-perfect about 2 months ago

Meaning of negative scores in EvolInstruct subset

4
#2 opened about 2 months ago by lewtun

Error when loading the dataset

5
#1 opened 2 months ago by lewtun
New activity in HuggingFaceH4/starchat2-15b-v0.1 2 months ago

fix the number of programming languages

1
#1 opened 2 months ago by loubnabnl
New activity in HuggingFaceH4/zephyr-chat 2 months ago

System prompt and Generation Config for better results?

1
#18 opened 7 months ago by Saugatkafley
New activity in codellama/CodeLlama-34b-Instruct-hf 3 months ago

Say no to chat templates 🙅‍♂️
#26 opened 3 months ago by lewtun
New activity in codellama/CodeLlama-13b-Instruct-hf 3 months ago

Fix le chat
#15 opened 3 months ago by lewtun
New activity in codellama/CodeLlama-7b-Instruct-hf 3 months ago

Fix chat template (again!)
#28 opened 3 months ago by lewtun

Add chat template

1
#27 opened 3 months ago by lewtun
New activity in codellama/CodeLlama-34b-Instruct-hf 3 months ago

Add chat template
#25 opened 3 months ago by lewtun
New activity in codellama/CodeLlama-13b-Instruct-hf 3 months ago

Add chat template
#14 opened 3 months ago by lewtun
New activity in HuggingFaceH4/zephyr-7b-gemma-v0.1 3 months ago

Adding Evaluation Results

1
#1 opened 3 months ago by leaderboard-pr-bot
New activity in abacaj/phi-2-super 3 months ago

Add IFEval score to metrics

1
#2 opened 3 months ago by lewtun
New activity in HuggingFaceH4/zephyr-chat 3 months ago

Upload OHIP Billing codes - Master July 2024.pdf
#27 opened 5 months ago by waelg

Upload OHIP Billing codes - Master July 2024.pdf
#28 opened 5 months ago by waelg
New activity in argilla/OpenHermesPreferences 3 months ago

Roughly half of the data does not have a "source" field?

1
#6 opened 3 months ago by wlhgtc

Small edits

1
#2 opened 3 months ago by dvilasuero
New activity in google/gemma-7b-it 3 months ago

Error while training gemma 7-b

5
#49 opened 3 months ago by Mansikalra
New activity in HuggingFaceH4/open_llm_leaderboard 3 months ago

Update src/display/about.py

1
#612 opened 3 months ago by lewtun
New activity in HuggingFaceH4/no_robots 3 months ago

Propose changes
#15 opened 4 months ago by myzz

5456
#14 opened 4 months ago by myzz
New activity in HuggingFaceH4/open_llm_leaderboard 3 months ago

Tweak description of TruthfulQA in About

1
#599 opened 3 months ago by lewtun
New activity in teknium/OpenHermes-2.5 3 months ago

License?

2
#9 opened 3 months ago by lewtun
New activity in HuggingFaceH4/constitutional-ai-demo 4 months ago

Move to node 20
#1 opened 4 months ago by nsarrazin
New activity in NousResearch/finetuning_subnet_leaderboard 4 months ago

Does head-to-head loss on the evaluation set measure capabilities or merely style?

1
#1 opened 4 months ago by lewtun
New activity in alignment-handbook/zephyr-7b-sft-full 4 months ago

Update README.md
#1 opened 4 months ago by lewtun
New activity in HuggingFaceH4/ultrafeedback_binarized 4 months ago

Upstream fixes from source dataset and filter out TruthfulQA samples

1
#3 opened 4 months ago by lewtun

dfsd
#2 opened 6 months ago by Yash2998db
New activity in hkust-nlp/deita-6k-v0 5 months ago

Suggestion to use a more permissive license

1
#2 opened 5 months ago by lewtun
commented a paper 5 months ago
New activity in llm-blender/PairRM 5 months ago

Run model with transformers?

2
#2 opened 5 months ago by lewtun
commented a paper 5 months ago
New activity in openchat/openchat_sharegpt4_dataset 5 months ago

What is the difference between the various openchat files?
#5 opened 5 months ago by lewtun
New activity in Nexusflow/Nexus_Function_Calling_Leaderboard 6 months ago

How to submit models to the leaderboard?

3
#1 opened 6 months ago by lewtun
New activity in HuggingFaceH4/no_robots 6 months ago

Upload Company Info.docx
#11 opened 6 months ago by Dank1
New activity in HuggingFaceH4/zephyr-7b-beta 6 months ago

[Feedback welcome] Add evaluation results to model card metadata

6
#40 opened 6 months ago by Wauplin
New activity in HuggingFaceH4/no_robots 6 months ago

test
#9 opened 6 months ago by suifengmangbu
New activity in ought/raft-leaderboard 6 months ago

Add maintenance message
#19 opened 6 months ago by lewtun

Validation and submission successful, but not on the leaderboard

7
#18 opened 8 months ago by HLaci
commented a paper 6 months ago
New activity in HuggingFaceH4/zephyr-chat 6 months ago

Update .env.local to match new backend refactoring

2
#23 opened 6 months ago by nsarrazin
New activity in HuggingFaceH4/zephyr-7b-beta 6 months ago

Add widget example
#34 opened 6 months ago by lewtun

Rename README.md to In
#24 opened 6 months ago by Shakel

Rename README.md to In
#23 opened 6 months ago by Shakel
New activity in allenai/tulu-2-dpo-70b 6 months ago

Add chat template to tokenizer config

1
#2 opened 6 months ago by lewtun
New activity in HuggingFaceH4/zephyr-7b-beta 6 months ago

Adding Evaluation Results

1
#31 opened 6 months ago by leaderboard-pr-bot

Update README.md

2
#28 opened 6 months ago by natolambert
New activity in HuggingFaceH4/no_robots 6 months ago

non-commercial license

20
#1 opened 6 months ago by clem

123
#3 opened 6 months ago by stasluzan
New activity in HuggingFaceH4/open_llm_leaderboard 6 months ago

Is `HuggingFaceH4/human_eval_llm_leaderboard` abandoned?

4
#355 opened 6 months ago by zhiminy