be able to use adam bnb 8bit and one cycle scheduler w fsdp 9493b1b winglian commited on May 22, 2023
Update src/axolotl/utils/models.py for info msg 1b3e401 unverified winglian Nanobit commited on May 22, 2023
Update src/axolotl/utils/data.py for spelling 98a6781 unverified winglian Nanobit commited on May 22, 2023
pygmalion dataset prompts format, cached tokenized datasets should be hashed on the tokenizer too 2809f3f winglian commited on May 21, 2023
reorder options so debug can happen in the same prepare step f98e173 winglian commited on May 16, 2023
move filter to before saving so it doesn't happen everytime, update runpod manual script 0d28df0 winglian commited on May 14, 2023
optimize dataloading to use cache, fix model token embedding sizes aa3c3f9 winglian commited on May 12, 2023
Merge pull request #26 from OpenAccess-AI-Collective/mpt-triton 688c73a unverified winglian commited on May 10, 2023
Fix Trainer() got multiple values for keyword argument 'callbacks' 813aab3 unverified Nanobit commited on May 10, 2023
Merge pull request #15 from NanoCode012/feat/completion 3f9c953 unverified winglian commited on May 8, 2023
Merge pull request #19 from NanoCode012/feat/callback-save-lora bcbc99e unverified winglian commited on May 8, 2023