Megatron LM training (fine-tuning) code ?
#9
by
StephennFernandes
- opened
is the megatron LM training/fine-tuning code open-sourced ?
can someone link it ?
Unfortunately, we don't have the Megatron-LM fine-tuning code open-sourced yet. However, we open-sourced the training data and the recipe at https://huggingface.co/datasets/nvidia/ChatQA-Training-Data
@zihanliu hey, thanks a ton for responding.
Is there any chance we could get the training code anytime soon ?
Hi. It could take quite some time for us to release training code, but we just released the training config files at https://huggingface.co/datasets/nvidia/ChatQA-Training-Data/tree/main Hope this can help. Let us know if you have more questions regarding the training.