s3nh commited on
Commit
7db363c
1 Parent(s): 142062f

Upload folder using huggingface_hub

Browse files
.ipynb_checkpoints/README-checkpoint.md ADDED
@@ -0,0 +1,44 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ ---
3
+ license: openrail
4
+ pipeline_tag: text-generation
5
+ library_name: transformers
6
+ language:
7
+ - zh
8
+ - en
9
+ ---
10
+
11
+
12
+ ## Original model card
13
+
14
+ Buy me a coffee if you like this project ;)
15
+ <a href="https://www.buymeacoffee.com/s3nh"><img src="https://www.buymeacoffee.com/assets/img/guidelines/download-assets-sm-1.svg" alt=""></a>
16
+
17
+ #### Description
18
+
19
+ GGML Format model files for [This project](https://huggingface.co/garage-bAInd/Camel-Platypus2-13B).
20
+
21
+
22
+ ### inference
23
+
24
+
25
+ ```python
26
+
27
+ import ctransformers
28
+
29
+ from ctransformers import AutoModelForCausalLM
30
+
31
+ model = AutoModelForCausalLM.from_pretrained(output_dir, ggml_file,
32
+ gpu_layers=32, model_type="llama")
33
+
34
+ manual_input: str = "Tell me about your last dream, please."
35
+
36
+
37
+ llm(manual_input,
38
+ max_new_tokens=256,
39
+ temperature=0.9,
40
+ top_p= 0.7)
41
+
42
+ ```
43
+
44
+ # Original model card
README.md ADDED
@@ -0,0 +1,44 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ ---
3
+ license: openrail
4
+ pipeline_tag: text-generation
5
+ library_name: transformers
6
+ language:
7
+ - zh
8
+ - en
9
+ ---
10
+
11
+
12
+ ## Original model card
13
+
14
+ Buy me a coffee if you like this project ;)
15
+ <a href="https://www.buymeacoffee.com/s3nh"><img src="https://www.buymeacoffee.com/assets/img/guidelines/download-assets-sm-1.svg" alt=""></a>
16
+
17
+ #### Description
18
+
19
+ GGML Format model files for [This project](https://huggingface.co/garage-bAInd/Camel-Platypus2-13B).
20
+
21
+
22
+ ### inference
23
+
24
+
25
+ ```python
26
+
27
+ import ctransformers
28
+
29
+ from ctransformers import AutoModelForCausalLM
30
+
31
+ model = AutoModelForCausalLM.from_pretrained(output_dir, ggml_file,
32
+ gpu_layers=32, model_type="llama")
33
+
34
+ manual_input: str = "Tell me about your last dream, please."
35
+
36
+
37
+ llm(manual_input,
38
+ max_new_tokens=256,
39
+ temperature=0.9,
40
+ top_p= 0.7)
41
+
42
+ ```
43
+
44
+ # Original model card
garage-bAInd-Camel-Platypus2-13B.ggmlv3.q4_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c7c6602464387a8c43beb145b5116dd5666d7c23382846e34d9cbd76638f3a4
3
+ size 7365545088
garage-bAInd-Camel-Platypus2-13B.ggmlv3.q4_1.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:53e43328357406d704714f96aa7ffd1ce939ee65a09dbe13457cbc64296ebf3b
3
+ size 8168770688
garage-bAInd-Camel-Platypus2-13B.ggmlv3.q5_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e85e315c1f3eb3f41152802351e96d1396514188a209caf9ccf80489db60623
3
+ size 8971996288
garage-bAInd-Camel-Platypus2-13B.ggmlv3.q5_1.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9acff0532acb7f84ad54bb88c64fc583f8464c5934ac5e345b03019113ea325b
3
+ size 9775221888
garage-bAInd-Camel-Platypus2-13B.ggmlv3.q8_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f79a7df12f4912c397261f81e6c09460f5481aac9ac42f834b4ae921e56ba4ab
3
+ size 13791349888