upstream-replit-updates
#43
by
winglian
- opened
No description provided.
updates the model code to replit's latest changes. see https://huggingface.co/replit/replit-code-v1-3b/commit/e023a8461c7a2e2f2c85e52dbdd8d68b415f95eb
winglian
changed pull request status to
open
fyi. there changes make the model work with the HF transformers trainer.
@abhi-mosaic , not sure if compatibility with the HF transformers trainer is related to PEFT training, but if so, the change to init configs might be important.
I think this is out of date/we periodically update the MPT code with the latest from LLM foundry.
daking
changed pull request status to
closed