End of training

README.md

@@ -1,6 +1,6 @@
 ---
 license: llama2
-base_model: codellama/CodeLlama-7b-hf
+base_model: codellama/CodeLlama-13b-hf
 tags:
 - generated_from_trainer
 model-index:
@@ -13,9 +13,9 @@ should probably proofread and complete it, then remove this comment. -->
 
 # code-llama-text-to-sparql
 
-This model is a fine-tuned version of [codellama/CodeLlama-7b-hf](https://huggingface.co/codellama/CodeLlama-7b-hf) on an unknown dataset.
+This model is a fine-tuned version of [codellama/CodeLlama-13b-hf](https://huggingface.co/codellama/CodeLlama-13b-hf) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.1969
+- Loss: 0.1870
 
 ## Model description
 
@@ -50,26 +50,26 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
-| 1.1337        | 0.0710 | 20   | 1.1247          |
-| 0.7318        | 0.1421 | 40   | 0.4634          |
-| 0.321         | 0.2131 | 60   | 0.3095          |
-| 0.2883        | 0.2842 | 80   | 0.2670          |
-| 0.2226        | 0.3552 | 100  | 0.2881          |
-| 0.2483        | 0.4263 | 120  | 0.2445          |
-| 0.2368        | 0.4973 | 140  | 0.2339          |
-| 0.2355        | 0.5684 | 160  | 0.2262          |
-| 0.2216        | 0.6394 | 180  | 0.2223          |
-| 0.2076        | 0.7105 | 200  | 0.2345          |
-| 0.2094        | 0.7815 | 220  | 0.2145          |
-| 0.2192        | 0.8526 | 240  | 0.2095          |
-| 0.2145        | 0.9236 | 260  | 0.2080          |
-| 0.2042        | 0.9947 | 280  | 0.2047          |
-| 0.2027        | 1.0657 | 300  | 0.2028          |
-| 0.2078        | 1.1368 | 320  | 0.2002          |
-| 0.1988        | 1.2078 | 340  | 0.2008          |
-| 0.2028        | 1.2789 | 360  | 0.1979          |
-| 0.1986        | 1.3499 | 380  | 0.1972          |
-| 0.2018        | 1.4210 | 400  | 0.1969          |
+| 1.0976        | 0.0710 | 20   | 1.0941          |
+| 0.5959        | 0.1421 | 40   | 0.3399          |
+| 0.3037        | 0.2131 | 60   | 0.2744          |
+| 0.2385        | 0.2842 | 80   | 0.2441          |
+| 0.2178        | 0.3552 | 100  | 0.2767          |
+| 0.2271        | 0.4263 | 120  | 0.2303          |
+| 0.2302        | 0.4973 | 140  | 0.2219          |
+| 0.2433        | 0.5684 | 160  | 0.2162          |
+| 0.2115        | 0.6394 | 180  | 0.2108          |
+| 0.199         | 0.7105 | 200  | 0.2151          |
+| 0.2117        | 0.7815 | 220  | 0.2071          |
+| 0.2107        | 0.8526 | 240  | 0.2004          |
+| 0.2008        | 0.9236 | 260  | 0.1990          |
+| 0.2083        | 0.9947 | 280  | 0.1953          |
+| 0.1905        | 1.0657 | 300  | 0.1933          |
+| 0.2001        | 1.1368 | 320  | 0.1905          |
+| 0.1887        | 1.2078 | 340  | 0.1905          |
+| 0.1921        | 1.2789 | 360  | 0.1880          |
+| 0.1837        | 1.3499 | 380  | 0.1870          |
+| 0.1951        | 1.4210 | 400  | 0.1870          |
 
 
 ### Framework versions

adapter_config.json

@@ -1,5 +1,5 @@
 {
-  "base_model_name_or_path": "codellama/CodeLlama-7b-hf",
+  "base_model_name_or_path": "codellama/CodeLlama-13b-hf",
   "bias": "none",
   "enable_lora": null,
   "fan_in_fan_out": false,

adapter_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:94ad8700b9a4a5daf3437d5f88d2fe69cfc1fe29b79232d9212bdb310819c1aa
-size 67201802
+oid sha256:9c45481da4dbc3bf130d955da7fe7c8ac262f9f093647695c0d0d083f1573b45
+size 104973834

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9484c2af318f1062491673b0333ffde7684776871e763cb0eb8c600c43677fc5
+oid sha256:ee61becd0124455401f98e9232ca9efe80fc5210deb6f63ad99d546146021fcf
 size 5176