Commit History
Add ORPO example and e2e test (#1572)
98c25e1
unverified
tokestermw
commited on
fix broken linting (#1541)
c10563c
unverified
winglian
commited on
strip out hacky qlora-fsdp workarounds now that qlora-fsdp fixes are upstreamed (#1428)
2a1589f
unverified
winglian
commited on
run tests again on Modal (#1289) [skip ci]
0001862
unverified
winglian
commited on
more fixes 20240228 (#1342) [skip ci]
0f985e1
unverified
winglian
commited on
make mlflow optional (#1317)
5894f0e
unverified
winglian
commited on
relora: magnitude pruning of the optimizer (#1245)
8c2e05a
unverified
winglian
commited on
support for true batches with multipack (#1230)
00568c1
unverified
winglian
commited on
Phi2 multipack (#1173)
814aee6
unverified
winglian
commited on
Falcon embeddings (#1149) [skip docker]
e799e08
unverified
winglian
commited on
Multipack simplify for Mixtral (#1142)
6910e6a
unverified
winglian
commited on
keep gate in fp32 for 16 bit loras (#1105)
da97285
unverified
winglian
commited on
attempt to also run e2e tests that needs gpus (#1070)
788649f
unverified
winglian
commited on
Phi2 rewrite (#1058)
732851f
unverified
winglian
commited on
bump transformers and update attention class map name (#1023)
bcc78d8
unverified
winglian
commited on
support for mamba (#915)
40a6362
unverified
winglian
commited on
Phi update 202311 (#876)
9bf854e
unverified
winglian
commited on
add e2e tests for checking functionality of resume from checkpoint (#865)
b3a61e8
unverified
winglian
commited on
use temp_dir kwarg instead
6dc68a6
winglian
commited on
missing dunder-init
7de6a56
winglian
commited on
chore: lint
c74f045
winglian
commited on
make sure to cleanup tmp output_dir for e2e tests
0402d19
winglian
commited on
simplify by removing duplicate base_model_config (#772)
2d8def6
unverified
winglian
commited on
remove lora fused packing test (#758)
21cf09b
unverified
winglian
commited on
Implement fused modules (#747)
15d3a65
unverified
Feat: Allow usage of native Mistral FA when no sample_packing (#669)
697c50d
unverified
Nanobit
commited on
add mistral e2e tests (#649)
5b0bc48
unverified
winglian
commited on
misc fixes to add gptq tests (#621)
03e5907
unverified
winglian
commited on
Support Sample packing for phi arch (#586)
12a2dbb
unverified
winglian
commited on
E2e device cuda (#575)
2414673
unverified
winglian
commited on
e2e testing (#574)
9218ebe
unverified
winglian
commited on