acalatrava commited on
Commit
1f5803f
1 Parent(s): 3da8f24

TinyLlama-1.1B-translate-en-es v2

Browse files
README.md CHANGED
@@ -13,7 +13,9 @@ language:
13
 
14
  # TinyLlama-1.1B-translate-en-es
15
 
16
- This is a finetuned version with a partial dataset from alvations/globalvoices-en-es to test performance on translation task. It has been trained to translate english to spanish and viceversa with only 10k rows from the dataset.
 
 
17
 
18
  The translation is not very accurate but it shows a lot of potential.
19
 
@@ -40,12 +42,10 @@ Spain is left without Copilot for Windows 11: the control of the UE has halted i
40
  ```
41
 
42
  ---
43
- The results are far from perfect but there are A LOT of room to improvement since it was finetuned with only 10k rows from the dataset (which has 355k rows) for 2 epoch. This training took only about 5 hours on a "M1 Pro" processor.
44
 
45
  The base model used is a fine-tuned model with orca dataset [acalatrava/TinyLlama-1.1B-orca-gpt4](https://huggingface.co/acalatrava/TinyLlama-1.1B-orca-gpt4)
46
 
47
- </div>
48
-
49
  ### Training
50
  - **Method**: QLORA
51
  - **Time**: 5h on a M1 Pro 32GB
 
13
 
14
  # TinyLlama-1.1B-translate-en-es
15
 
16
+ </div>
17
+
18
+ This is a finetuned version with a partial dataset from alvations/globalvoices-en-es to test performance on translation task. It has been trained to translate english to spanish and viceversa with only 20k rows from the dataset.
19
 
20
  The translation is not very accurate but it shows a lot of potential.
21
 
 
42
  ```
43
 
44
  ---
45
+ The results are far from perfect but there are A LOT of room to improvement since it was finetuned with only 20k rows from the dataset (which has 355k rows) for 2 epoch. This training took only about 5 hours on a "M1 Pro" processor.
46
 
47
  The base model used is a fine-tuned model with orca dataset [acalatrava/TinyLlama-1.1B-orca-gpt4](https://huggingface.co/acalatrava/TinyLlama-1.1B-orca-gpt4)
48
 
 
 
49
  ### Training
50
  - **Method**: QLORA
51
  - **Time**: 5h on a M1 Pro 32GB
params_shard_1.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:88fedb7e0e9e229c94faa91d8c784c123698e7b361382049b2cbf482f278e360
3
  size 31825920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e379538b88315cebbbb6925b4b24b9d51a1e3da61d27bf0f762c77a355f81616
3
  size 31825920
params_shard_10.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6c0f79febad45ae3aec5709e68dce246af4d9ce9f5ed256e98a22384545cd5c6
3
  size 24780800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1a52c09ed67d790d57b43dcfe4439e7eaf4643f8e7dcdd39d93c6f7a19264604
3
  size 24780800
params_shard_11.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5e9d2b02c95315dc6e18772e6239531d6717937c6b29826393fb71764879ebfe
3
  size 24780800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa85357f9985dda0ed5a5a2cd797a6adbad3b463aa23ecd1231b33bbb701439d
3
  size 24780800
params_shard_12.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ff2c44e730562c38a3121c69c715bf000227fe640ee99fbe0a7094ca9379d99a
3
  size 24780800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0aec6b03b0edd54d53001766ac783f0d02c2dd865f47ca2fe3ffe735f68998e7
3
  size 24780800
params_shard_13.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e64d246b31923556b51bfc478d72cbfb83c179c10b518b9e62e049ef81586360
3
  size 24780800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:17d728de276ce5d3ba292063d77a3f6c629f3de1216dc4ca47a9f7b1239d54fb
3
  size 24780800
params_shard_14.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a57d422dd21dba66f86bc7c5490d9069fe796050187364900603d8b6344f02de
3
  size 24780800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b697abb6f512a0c2ae979c649b0f2a7d4f8182f678fb12e17a61c6dff446bb2
3
  size 24780800
params_shard_15.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:072ae42bffaea08bf3be7eaac0ca1467b49d1862d9db51903bea22100357bc8e
3
  size 24780800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a46a6217aea97e47cb8fa0c7ba91142b3390a59d2b11be0b5793cc2c8320b467
3
  size 24780800
params_shard_16.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ac06784be432b51453a8500fc0481169cf3c60c6ab251d5aefc9ac8ed70a3969
3
  size 24780800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f8007abad5e506b63f85afb943e4a2ded4684a0da963212fa6716657418427d
3
  size 24780800
params_shard_17.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:95a95c0c3e7e6ce9bc3521b2979c5571653875924cf9ec891bcf236fc7519f4e
3
  size 24780800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e3995ac6df9a9e909d43df83279c7641202f85477c8367ca9324358e53c962fa
3
  size 24780800
params_shard_18.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:120a01618010f7d0e56097bf2ad72aca3befade730adf853b0d7517d4a239063
3
  size 24780800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0cbb806708b2e8c59e32b1eac11eaf6776830aaaa62be37c33fd14f7c10d7952
3
  size 24780800
params_shard_19.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3fa06226e62682ae0551d3a42125d13dafb64520adfe47df8596a56c75fa5978
3
  size 24780800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:99c27ed0525810c19a2afdf06dd05c4680c299a7a595d66758a93ec6486d6960
3
  size 24780800
params_shard_2.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b731994d08bbc14d2eb7ae48a15bd09798b36026faec181e345a26b53c51e916
3
  size 27140096
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d2671979b0b1524bbdd741deb7ecb985f427adf1176a5247f89f37f41d646d24
3
  size 27140096
params_shard_20.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e8cf72d6a3f296bad6b1179f51d55a5f03f0b6e65529c3080a722c8139f72faa
3
  size 24780800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a5c92ba0f0a1a2da9ccfce2ad2bd9edff42e000f608c11230e0f254dce32016
3
  size 24780800
params_shard_21.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6e2a2209fef872e258fda548e802df1cda6b3d3793c482a035bca04f4287d41e
3
  size 24780800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:42734829b0036fd18d9b7759d5ed7d0ecf3fc0efd134db6acd13167c09d4b7d5
3
  size 24780800
params_shard_3.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d76db62da9b990b5cbaf71378d9c9974a1daf045c1d09da2a9f36fba61b1bea7
3
  size 24780800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0fee5401a9ffd8bc571fa389029241307bdb9aa6389149384bd4c12e47dc7700
3
  size 24780800
params_shard_4.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d2686dbc4e89fd43b29fea93e99132db8c5cfde55f0f976458206a87b29824e1
3
  size 24780800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:958eadb932ee5bed0e17e4f88e700fd615a2c2a98f78ad1f8fc5237d30b57cec
3
  size 24780800
params_shard_5.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bf9ae5d8162e254925dad34f2ed02ec355b08e56dce75863262a184713d51fac
3
  size 24780800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4ffccda3298bca3b04f9dcaff525932b40127287a9d2e53ee1ea749c57b9538
3
  size 24780800
params_shard_6.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0356c13b1a82f129da122a6284521f5e246aa73314ce1137573f2341ba88aebb
3
  size 24780800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c8e1458ca521ede434f05783eea108e96f44a18b5a08b480a8d71ab9fc9eb7c3
3
  size 24780800
params_shard_7.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9ff4d0857f846072bb6d11f272da6a13f614de652e31537e81720cbd654f455d
3
  size 24780800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a494da41eb4ff449de91ad5471102b579791b7128be07fa338961bd2c2c91848
3
  size 24780800
params_shard_8.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:96de34d850a55b5739a6fcbe2b2018684e2a5c220520fe5cf406d06ea0a3c2c8
3
  size 24780800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cdf232adf87feb7dd697feb5636ccbe333b657d45af5fd48f18a8aa800db8ea8
3
  size 24780800
params_shard_9.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:170c6c17e635921f010d70bf67ad2beda480668ee8bdcc60336b70106e0fb9d9
3
  size 24780800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9bfac5bd1c83f6bec4304258eb06ee614173f58a255548d865e09f9478b47706
3
  size 24780800