The environment to run training of mpt
#12
by
wangjw-bd
- opened
I am trying to run training of mpt with flash attn (triton), but I encountered some trouble with the environment. Can you share the pip requirements? thx
Please check out the LLM Foundry (https://github.com/mosaicml/llm-foundry/tree/main)
and the requirements are here: https://github.com/mosaicml/llm-foundry/blob/3959eaccba53c444c5705d600d333cc3d47bc06c/setup.py#L48
daking
changed discussion status to
closed