smohammadi/torchtune_test

My Torchtune Model

This model is a finetuned version of google/gemma-2b

Model description

More information needed

Training and evaluation results

More information needed

Training procedure

This model was trained using the torchtune library using the following command:

/Users/salmanmohammadi/projects/torchtune/recipes/lora_finetune_single_device.py --config /Users/salmanmohammadi/projects/torchtune/recipes/configs/gemma/2B_lora_single_device.yaml \
 device=mps \
 epochs=1 \
 max_steps_per_epoch=10

Framework versions

• torchtune 0.0.0
• torchao 0.5.0
• datasets 2.20.0
• sentencepiece 0.2.0