morriszms commited on
Commit
4b66c40
·
verified ·
1 Parent(s): 986a02e

Upload folder using huggingface_hub

Browse files
README.md CHANGED
@@ -1,22 +1,17 @@
1
  ---
 
 
2
  library_name: transformers
3
- license: gemma
4
- widget:
5
- - messages:
6
- - role: user
7
- content: How does the brain work?
8
- inference:
9
- parameters:
10
- max_new_tokens: 200
11
- extra_gated_heading: Access Gemma on Hugging Face
12
- extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and
13
- agree to Google’s usage license. To do this, please ensure you’re logged-in to Hugging
14
- Face and click below. Requests are processed immediately.
15
- extra_gated_button_content: Acknowledge license
16
- base_model: google/gemma-1.1-2b-it
17
  tags:
 
 
 
 
 
18
  - TensorBlock
19
  - GGUF
 
20
  ---
21
 
22
  <div style="width: auto; margin-left: auto; margin-right: auto">
@@ -30,11 +25,11 @@ tags:
30
  </div>
31
  </div>
32
 
33
- ## google/gemma-1.1-2b-it - GGUF
34
 
35
- This repo contains GGUF format model files for [google/gemma-1.1-2b-it](https://huggingface.co/google/gemma-1.1-2b-it).
36
 
37
- The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
38
 
39
  <div style="text-align: left; margin: 20px 0;">
40
  <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
 
1
  ---
2
+ language:
3
+ - en
4
  library_name: transformers
5
+ license: apache-2.0
 
 
 
 
 
 
 
 
 
 
 
 
 
6
  tags:
7
+ - unsloth
8
+ - transformers
9
+ - gemma
10
+ - gemma-2b
11
+ - bnb
12
  - TensorBlock
13
  - GGUF
14
+ base_model: unsloth/gemma-1.1-2b-it
15
  ---
16
 
17
  <div style="width: auto; margin-left: auto; margin-right: auto">
 
25
  </div>
26
  </div>
27
 
28
+ ## unsloth/gemma-1.1-2b-it - GGUF
29
 
30
+ This repo contains GGUF format model files for [unsloth/gemma-1.1-2b-it](https://huggingface.co/unsloth/gemma-1.1-2b-it).
31
 
32
+ The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4242](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
33
 
34
  <div style="text-align: left; margin: 20px 0;">
35
  <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
gemma-1.1-2b-it-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2dc5182d1e5efe68f12c385d7a90c1ba4b467be321633e19be73af892527f72c
3
- size 1157924928
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4816e9474491502f03dbc6e068d231894e87a2c123f5ec040999f80bdcea68a6
3
+ size 1157924128
gemma-1.1-2b-it-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5cf0af26ffdf88341a36f4abbf282b6a4c5ccf1b93e4659336f12421dd35f6a4
3
- size 1465591872
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8461d5a1c511b9c38ff48243ba4d269d6c44d1a5670d09f4815adacc37957ef3
3
+ size 1465591072
gemma-1.1-2b-it-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:94f184976da002d1f8bc2c59b08e985c3e33d1d7e2c4889c5c2c4b586b90e720
3
- size 1383802944
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb468660d283f7b3c3037936ee89a2fdab5a9411f56f45651032e6abc831815f
3
+ size 1383802144
gemma-1.1-2b-it-Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d061d14a97a877e68f8ec7ad080ab714cee6f45eaf37250aabf6a5fbfa1a37fe
3
- size 1287981120
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ea96431de5901a8320ad8b6d21e5a8fbb4a4583df66413c469823fc85e7b7ec5
3
+ size 1287980320
gemma-1.1-2b-it-Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4083481315ca36d084ac5f30bc3dd1c61c4a052be58794db59bb8db5069c4a0e
3
- size 1551190080
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1577c73b838091b1c50e089d76abe43a79c8e35c938a4e6fd90a75c1edd1b9ca
3
+ size 1551189280
gemma-1.1-2b-it-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ea70f9c722de453f65da9677e5c6a83163488b6015fc63b716509b36ea501e5f
3
- size 1630263360
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:137f4df86d4748af4dd40abc89e7e423cfccba2a7abcfc1c975a0badfc18bc68
3
+ size 1630262560
gemma-1.1-2b-it-Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:99c0bb5745baec412cdb4f2f2b1c557a6092ea34f71e1e476c219822f3c857d5
3
- size 1559840832
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0416af9fdf5b23ab93acf8efeffc9fa54baa12ac4aa5ba38a70c4868a8344340
3
+ size 1559840032
gemma-1.1-2b-it-Q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e7a86a3804e7ee9f7de8f2ad9de9e962c3f35320fedaab7513debbb097dc08f4
3
- size 1798916160
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6f47022b2df979ed3e9fcc34d673827fac0aea5efbc8c01c8b2fb50191a85a8d
3
+ size 1798915360
gemma-1.1-2b-it-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2a5ee145e1236caf01892790c0e0beac46320ccf17241c3d834b27280b9bf029
3
- size 1839650880
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:81bec8f58bbd1f18aaf14f1fc09086d30df91b6974ad0b1d25d6f30d8e713dd5
3
+ size 1839650080
gemma-1.1-2b-it-Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7898fe7390eb1c4099311c79922cf1f15c4b538f6f567e7824b5f6c002b27863
3
- size 1798916160
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:66130d2b31612876477713b578c8cb0eff212241671f6c85a1d6e197645e3299
3
+ size 1798915360
gemma-1.1-2b-it-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:49c5fd13c5d383a1d4a650448cb0a9114a9cb7b63ceca31f7ed95e2c9eaaf1d0
3
- size 2062125120
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6df4d2ae5f24afa391cd38508be348832852306d63dbeed865d0394454a3b419
3
+ size 2062124320
gemma-1.1-2b-it-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f1382fdb441549ac1499713db2173ed715a6f8d51874d55dbd9c146193fe0be2
3
- size 2669070400
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf88941ad44eb6cc65336d83de7b815d077ba8f711754e6c67bfc79b189f3959
3
+ size 2669069600