Models and datasets to align LLMs with Odds Ratio Preference Optimisation (ORPO). Recipes here: https://github.com/huggingface/alignment-handbook
Hugging Face H4
Enterprise
company
AI & ML interests
Aligning LLMs to be helpful, honest, harmless, and huggy (H4)
Organization Card
Hello world!
We're the Hugging Face H4 team, focused on aligning language models to be helpful, honest, harmless, and huggy 🤗.
models
30
HuggingFaceH4/sft-llava-1.5-7b-hf
Updated
HuggingFaceH4/EleutherAI_pythia-6.9b-deduped__sft__tldr
Text Generation
•
Updated
•
63
HuggingFaceH4/dummy-repo-without-revision-e0c007b1-25d2-4527-b8ec-c6f54821a847
Updated
HuggingFaceH4/dummy-repo-with-revision-5d2f53d0-61c1-4943-ba1c-68ec8507051b
Updated
HuggingFaceH4/dummy-repo-with-revision-b961bb0f-8012-48f9-8bcc-8373d10e3868
Updated
HuggingFaceH4/dummy-repo-without-revision-46fd598b-6792-48e0-9c14-fe86fc035183
Updated
HuggingFaceH4/dummy-repo-with-revision-00a840ca-835f-4370-a2d7-6cb15e1fbdfa
Updated
HuggingFaceH4/dummy-repo-without-revision-2faed7c2-f2e5-4bba-aff4-36b7c05e6f55
Updated
HuggingFaceH4/dummy-repo-with-revision-dcaba972-9df6-4e8c-bdc1-e7866798a289
Updated
HuggingFaceH4/dummy-repo-without-revision-aa4674a9-930a-4a05-80fe-48924b58f04a
Updated
datasets
68
HuggingFaceH4/test-cot
Viewer
•
Updated
•
1.32k
•
1
HuggingFaceH4/rlaif-v_formatted
Viewer
•
Updated
•
83.1k
•
608
HuggingFaceH4/no_robots
Viewer
•
Updated
•
10k
•
8.52k
•
407
HuggingFaceH4/orca_dpo_pairs
Viewer
•
Updated
•
12.9k
•
968
•
20
HuggingFaceH4/llava-instruct-mix-vsft
Viewer
•
Updated
•
273k
•
2.11k
•
17
HuggingFaceH4/h4_10k_prompts_ranked_gen
Viewer
•
Updated
•
10.3k
•
7
•
3
HuggingFaceH4/h4-anthropic-hh-rlhf-helpful-base-gen
Viewer
•
Updated
•
46.2k
•
9
•
3
HuggingFaceH4/capybara
Viewer
•
Updated
•
16k
•
4.66k
•
9
HuggingFaceH4/SystemChat
Viewer
•
Updated
•
7.02k
•
736
•
7
HuggingFaceH4/orca-math-word-problems-200k
Viewer
•
Updated
•
200k
•
783
•
8