FIX: max_length and max_prompt_length was not being sent to ORPOTrainer (#1584) 1e1921b unverified alimosavian Ali Mosavian winglian commited on May 14
feat: Add LLaMA-3 instruct prompt strategies for fine-tuning (#1553) 50421c8 unverified Ram Ram winglian commited on May 11
adding llama3 fastchat conversation monkeypatch (#1539) b32c08f unverified Antoni-Joan Solergibert winglian commited on May 10
make sure to save the lora adapter at the end of RL/dpo training (#1573) 796a085 unverified winglian commited on May 8
Pass deepspeed and fsdp as None explicitly when merging adapters to allow custom device_map (#1575) 9e1480e unverified chiragjn commited on May 7
Gradio configuration parameters (#1591) 3367fca unverified marijnfs Marijn Stollenga Marijn Stollenga winglian commited on May 6
Pass weakref to model in the SIGINT handler to free up model post train function (#1581) dde02fc unverified chiragjn winglian commited on May 3
FIX: TRL trainer preprocessing step was running in one process (#1583) b9bb169 unverified Ali Mosavian Ali Mosavian commited on May 3
Add debug option for RL dataset preprocessing (#1404) cc5d31e unverified abhinand Nanobit commited on Apr 30
make sure everything stays in the same dtype when using dpo + FSDP (#1559) 68601ec unverified winglian commited on Apr 22
Add support for Gemma chat template (#1530) 60f5ce0 unverified Haoxiang-Wang winglian commited on Apr 21
wrap prepared_ds_path in str() to avoid TypeError in fsspec package (#1548) 7477a53 unverified Frank Ruis winglian commited on Apr 21
Update SaveAxolotlConfigtoWandBCallback to use artifact instead of save (#1483) 5ed2939 unverified tcapelle winglian commited on Apr 9
use locale agnostic seperator to make large nums easier to read (#1503) da9b1a3 unverified winglian commited on Apr 9
WIP: Support table logging for mlflow, too (#1506) 057fa44 unverified DavidFarago Dave Farago winglian commited on Apr 9
Correctly handle splits for datasets.arrow_dataset.Dataset objects (#1504) 8fa0785 unverified scottifer8 winglian commited on Apr 9
add field to sft dataset pydantic for completion support (#1497) ff01c45 unverified winglian commited on Apr 9
ignore issues with calculating # params when printing (#1493) 2fa65b9 unverified winglian commited on Apr 8
drop empty token from beginning if tokenizer has no bos_token (in the case of qwen) (#1490) 934fc85 unverified winglian commited on Apr 7
feat: validate sample packing requires flash_attention (#1465) bf4cd67 unverified Nanobit commited on Apr 5
refactor utils.data module for line count linter (#1476) e0fcef4 unverified winglian commited on Apr 4
Support loading datasets saved via save_to_disk (#1432) e634118 unverified fozziethebeat commited on Mar 29
support layer replication for peft and fix rslora integration (#1445) 25afd35 unverified winglian commited on Mar 27
fix for accelerate env var for auto bf16, add new base image and expand torch_cuda_arch_list support (#1413) da265dd unverified winglian commited on Mar 26