Spaces:

Dovakiins
/

qwerrwe

Build error

App Files Files Community

qwerrwe / src /axolotl /utils

100 contributors

History: 344 commits

winglian's picture

fixes for alpaca w chatml, and don't include attention_mask w mistral for flash attention (#728)

3553172 unverified about 1 year ago

__init__.py

0 Bytes

WIP large refactor to make finetune script a little more manageable (#3) over 1 year ago
bench.py

2.06 kB

misc fixes to add gptq tests (#621) about 1 year ago
callbacks.py

20.8 kB

Save Axolotl config as WandB artifact (#716) about 1 year ago
collators.py

5.39 kB

Attention mask and position id fixes for packing (#285) over 1 year ago
config.py

13.5 kB

refactor to set eval_batch_size earlier if unset, so we can warn if mismatched (#662) about 1 year ago
data.py

25 kB

improve handling of the prepared ds path and other cfg defaults (#701) about 1 year ago
dataloader.py

9.94 kB

gracefully handle length feature used for group by (#565) about 1 year ago
dict.py

326 Bytes

fix DefaultDict.__or__ over 1 year ago
distributed.py

6.87 kB

fix distributed devices (#612) about 1 year ago
models.py

21.4 kB

add noisy embedding (#721) about 1 year ago
schedulers.py

3.58 kB

add axolotl trainer and quadratic warmup over 1 year ago
tokenization.py

1.47 kB

prepared dataset caching, other misc fixes (#665) about 1 year ago
trainer.py

29.9 kB

fixes for alpaca w chatml, and don't include attention_mask w mistral for flash attention (#728) about 1 year ago
wandb_.py

858 Bytes

fix wandb so mypy doesn't complain (#562) about 1 year ago