Text Generation
Transformers
PyTorch
English
llama
text-generation-inference
Inference Endpoints
acalatrava commited on
Commit
22f9e9d
1 Parent(s): a5d6f4a
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -19,7 +19,7 @@ This is a fine-tuned version of [TinyLlama-1.1B-intermediate-step-240k-503b](htt
19
 
20
  ### Training
21
  - **Method**: QLORA
22
- - **Quantization**: 16bit
23
  - **Time**: 20h on a RTX 4090 (from runpod.io)
24
  - **Cost**: About $15
25
  - **Based on**: [https://colab.research.google.com/drive/1Zmaceu65d7w4Tcd-cfnZRb6k_Tcv2b8g](https://colab.research.google.com/drive/1Zmaceu65d7w4Tcd-cfnZRb6k_Tcv2b8g)
 
19
 
20
  ### Training
21
  - **Method**: QLORA
22
+ - **Quantization**: fp16
23
  - **Time**: 20h on a RTX 4090 (from runpod.io)
24
  - **Cost**: About $15
25
  - **Based on**: [https://colab.research.google.com/drive/1Zmaceu65d7w4Tcd-cfnZRb6k_Tcv2b8g](https://colab.research.google.com/drive/1Zmaceu65d7w4Tcd-cfnZRb6k_Tcv2b8g)