add .safetensors

README.md

@@ -0,0 +1,16 @@
+---
+datasets:
+- amazon/MistralLite
+language:
+- en
+pipeline_tag: text-generation
+license: apache-2.0
+---
+
+This repo includes `.gguf` built for HuggingFace/Candle.
+They will not work with `llama.cpp`.
+
+This model should be used with the `Config` [`config_chat_ml`](
+https://github.com/huggingface/candle/blob/main/candle-transformers/src/models/mistral.rs).
+
+Refer to the [original repo](https://huggingface.co/amazon/MistralLite) for more details.

model-00001-of-00002.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9e88407bd84644fe9b69247796672afca2242c235eb6d75264abc772360b27fc
+size 9943006240

model-00002-of-00002.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c8342a0da8dcb5846c8099ba209a806fc796e7f3e295cb72d7b70c7636609bf9
+size 4540540888