GGUF
English
llama-cpp
ProCreations commited on
Commit
c30bab0
1 Parent(s): c83f33b

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +37 -0
README.md ADDED
@@ -0,0 +1,37 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ license: apache-2.0
5
+ tags:
6
+ - llama-cpp
7
+ datasets:
8
+ - cerebras/SlimPajama-627B
9
+ - bigcode/starcoderdata
10
+ - HuggingFaceH4/ultrachat_200k
11
+ - HuggingFaceH4/ultrafeedback_binarized
12
+ widget:
13
+ - example_title: Fibonacci (Python)
14
+ messages:
15
+ - role: system
16
+ content: You are a chatbot who can help code!
17
+ - role: user
18
+ content: Write me a function to calculate the first 10 digits of the fibonacci
19
+ sequence in Python and print it out to the CLI.
20
+ ---
21
+
22
+ # ProCreations/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF
23
+ This model was converted to GGUF format from [`TinyLlama/TinyLlama-1.1B-Chat-v1.0`](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0) using llama.cpp.
24
+ Refer to the [original model card](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0) for more details on the model.
25
+ ## Use with llama.cpp
26
+
27
+ ```bash
28
+ brew install ggerganov/ggerganov/llama.cpp
29
+ ```
30
+
31
+ ```bash
32
+ llama-cli --hf-repo ProCreations/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF --model tinyllama-1.1b-chat-v1.0.Q4_K_M.gguf -p "The meaning to life and the universe is "
33
+ ```
34
+
35
+ ```bash
36
+ llama-server --hf-repo ProCreations/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF --model tinyllama-1.1b-chat-v1.0.Q4_K_M.gguf -c 2048
37
+ ```