David Faragó

dball's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

commented 4 papers 4 months ago

CantTalkAboutThis: Aligning Language Models to Stay on Topic in Dialogues

Paper • 2404.03820 • Published Apr 4 • 22 •

5

ReFT: Representation Finetuning for Language Models

Paper • 2404.03592 • Published Apr 4 • 77 •

17

Mixture-of-Depths: Dynamically allocating compute in transformer-based language models

Paper • 2404.02258 • Published Apr 2 • 102 •

6

Training LLMs over Neurally Compressed Text

Paper • 2404.03626 • Published Apr 4 • 21 •

3

commented 2 papers 5 months ago

Self-Rewarding Language Models

Paper • 2401.10020 • Published Jan 18 • 138 •

17

Self-Consuming Generative Models Go MAD

Paper • 2307.01850 • Published Jul 4, 2023 • 1 •

1

New activity in dball/zephyr-7b-sft-qlora 6 months ago

Is the drop in many metrics expected? Why do SFT first if it makes the model worse? Why not do DPO directly on the mistral model?

1

#1 opened 6 months ago by dball

New activity in dball/zephyr-7b-dpo-qlora 6 months ago

Is the high drop in GSM8K usual?

1

#1 opened 6 months ago by dball

New activity in teknium/CollectiveCognition-v1.1-Mistral-7B 6 months ago

Training code?

4

#5 opened 9 months ago by umarmnaq

New activity in malhajar/Mistral-7B-v0.2-meditron-turkish 6 months ago

Training script?

1

#1 opened 6 months ago by dball

New activity in fxmarty/tiny-llama-fast-tokenizer 11 months ago

Bugs when loading tokenizer or model

1

#3 opened 11 months ago by dball

New activity in Yhyu13/oasst-rlhf-2-llama-30b-7k-steps-hf 12 months ago

How did you merge?

1

#1 opened 12 months ago by dball

New activity in garage-bAInd/GPlatty-30B 12 months ago

Curious about model design

2

#2 opened about 1 year ago by surya-narayanan