LLukas22 commited on
Commit
ef4ba42
1 Parent(s): 6b1a6b5

Upload 2 files

Browse files
Files changed (2) hide show
  1. README_TEMPLATE.md +110 -0
  2. config.json +1 -0
README_TEMPLATE.md ADDED
@@ -0,0 +1,110 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: bigscience-bloom-rail-1.0
3
+ language:
4
+ - ak
5
+ - ar
6
+ - as
7
+ - bm
8
+ - bn
9
+ - ca
10
+ - code
11
+ - en
12
+ - es
13
+ - eu
14
+ - fon
15
+ - fr
16
+ - gu
17
+ - hi
18
+ - id
19
+ - ig
20
+ - ki
21
+ - kn
22
+ - lg
23
+ - ln
24
+ - ml
25
+ - mr
26
+ - ne
27
+ - nso
28
+ - ny
29
+ - or
30
+ - pa
31
+ - pt
32
+ - rn
33
+ - rw
34
+ - sn
35
+ - st
36
+ - sw
37
+ - ta
38
+ - te
39
+ - tn
40
+ - ts
41
+ - tum
42
+ - tw
43
+ - ur
44
+ - vi
45
+ - wo
46
+ - xh
47
+ - yo
48
+ - zh
49
+ - zu
50
+ programming_language:
51
+ - C
52
+ - C++
53
+ - C#
54
+ - Go
55
+ - Java
56
+ - JavaScript
57
+ - Lua
58
+ - PHP
59
+ - Python
60
+ - Ruby
61
+ - Rust
62
+ - Scala
63
+ - TypeScript
64
+ tags:
65
+ - llm-rs
66
+ - ggml
67
+ pipeline_tag: text-generation
68
+ ---
69
+
70
+ # GGML covnerted Models of [BigScience](https://huggingface.co/bigscience)'s Bloom models
71
+
72
+ ## Description
73
+
74
+ BLOOM is an autoregressive Large Language Model (LLM), trained to continue text from a prompt on vast amounts of text data using industrial-scale computational resources. As such, it is able to output coherent text in 46 languages and 13 programming languages that is hardly distinguishable from text written by humans. BLOOM can also be instructed to perform text tasks it hasn't been explicitly trained for, by casting them as text generation tasks.
75
+
76
+
77
+ ## Converted Models
78
+ $MODELS$
79
+
80
+ ## Usage
81
+
82
+ ### Python via [llm-rs](https://github.com/LLukas22/llm-rs-python):
83
+
84
+ #### Installation
85
+ Via pip: `pip install llm-rs`
86
+
87
+ #### Run inference
88
+ ```python
89
+ from llm_rs import AutoModel
90
+
91
+ #Load the model, define any model you like from the list above as the `model_file`
92
+ model = AutoModel.from_pretrained("rustformers/bloom-ggml",model_file="bloom-3b-q4_0-ggjt.bin")
93
+
94
+ #Generate
95
+ print(model.generate("The meaning of life is"))
96
+ ```
97
+
98
+ ### Rust via [Rustformers/llm](https://github.com/rustformers/llm):
99
+
100
+ #### Installation
101
+ ```
102
+ git clone --recurse-submodules https://github.com/rustformers/llm.git
103
+ cd llm
104
+ cargo build --release
105
+ ```
106
+
107
+ #### Run inference
108
+ ```
109
+ cargo run --release -- bloom infer -m path/to/model.bin -p "Tell me how cool the Rust programming language is:"
110
+ ```
config.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"repo_type": "GGML"}