RichardErkhov commited on
Commit
be42b8b
1 Parent(s): bf1060e

uploaded readme

Browse files
Files changed (1) hide show
  1. README.md +95 -0
README.md ADDED
@@ -0,0 +1,95 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Quantization made by Richard Erkhov.
2
+
3
+ [Github](https://github.com/RichardErkhov)
4
+
5
+ [Discord](https://discord.gg/pvy7H8DZMG)
6
+
7
+ [Request more models](https://github.com/RichardErkhov/quant_request)
8
+
9
+
10
+ lmlab-mistral-1b-untrained - GGUF
11
+ - Model creator: https://huggingface.co/lmlab/
12
+ - Original model: https://huggingface.co/lmlab/lmlab-mistral-1b-untrained/
13
+
14
+
15
+ | Name | Quant method | Size |
16
+ | ---- | ---- | ---- |
17
+ | [lmlab-mistral-1b-untrained.Q2_K.gguf](https://huggingface.co/RichardErkhov/lmlab_-_lmlab-mistral-1b-untrained-gguf/blob/main/lmlab-mistral-1b-untrained.Q2_K.gguf) | Q2_K | 0.44GB |
18
+ | [lmlab-mistral-1b-untrained.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/lmlab_-_lmlab-mistral-1b-untrained-gguf/blob/main/lmlab-mistral-1b-untrained.IQ3_XS.gguf) | IQ3_XS | 0.49GB |
19
+ | [lmlab-mistral-1b-untrained.IQ3_S.gguf](https://huggingface.co/RichardErkhov/lmlab_-_lmlab-mistral-1b-untrained-gguf/blob/main/lmlab-mistral-1b-untrained.IQ3_S.gguf) | IQ3_S | 0.5GB |
20
+ | [lmlab-mistral-1b-untrained.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/lmlab_-_lmlab-mistral-1b-untrained-gguf/blob/main/lmlab-mistral-1b-untrained.Q3_K_S.gguf) | Q3_K_S | 0.5GB |
21
+ | [lmlab-mistral-1b-untrained.IQ3_M.gguf](https://huggingface.co/RichardErkhov/lmlab_-_lmlab-mistral-1b-untrained-gguf/blob/main/lmlab-mistral-1b-untrained.IQ3_M.gguf) | IQ3_M | 0.51GB |
22
+ | [lmlab-mistral-1b-untrained.Q3_K.gguf](https://huggingface.co/RichardErkhov/lmlab_-_lmlab-mistral-1b-untrained-gguf/blob/main/lmlab-mistral-1b-untrained.Q3_K.gguf) | Q3_K | 0.54GB |
23
+ | [lmlab-mistral-1b-untrained.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/lmlab_-_lmlab-mistral-1b-untrained-gguf/blob/main/lmlab-mistral-1b-untrained.Q3_K_M.gguf) | Q3_K_M | 0.54GB |
24
+ | [lmlab-mistral-1b-untrained.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/lmlab_-_lmlab-mistral-1b-untrained-gguf/blob/main/lmlab-mistral-1b-untrained.Q3_K_L.gguf) | Q3_K_L | 0.58GB |
25
+ | [lmlab-mistral-1b-untrained.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/lmlab_-_lmlab-mistral-1b-untrained-gguf/blob/main/lmlab-mistral-1b-untrained.IQ4_XS.gguf) | IQ4_XS | 0.6GB |
26
+ | [lmlab-mistral-1b-untrained.Q4_0.gguf](https://huggingface.co/RichardErkhov/lmlab_-_lmlab-mistral-1b-untrained-gguf/blob/main/lmlab-mistral-1b-untrained.Q4_0.gguf) | Q4_0 | 0.63GB |
27
+ | [lmlab-mistral-1b-untrained.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/lmlab_-_lmlab-mistral-1b-untrained-gguf/blob/main/lmlab-mistral-1b-untrained.IQ4_NL.gguf) | IQ4_NL | 0.63GB |
28
+ | [lmlab-mistral-1b-untrained.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/lmlab_-_lmlab-mistral-1b-untrained-gguf/blob/main/lmlab-mistral-1b-untrained.Q4_K_S.gguf) | Q4_K_S | 0.63GB |
29
+ | [lmlab-mistral-1b-untrained.Q4_K.gguf](https://huggingface.co/RichardErkhov/lmlab_-_lmlab-mistral-1b-untrained-gguf/blob/main/lmlab-mistral-1b-untrained.Q4_K.gguf) | Q4_K | 0.66GB |
30
+ | [lmlab-mistral-1b-untrained.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/lmlab_-_lmlab-mistral-1b-untrained-gguf/blob/main/lmlab-mistral-1b-untrained.Q4_K_M.gguf) | Q4_K_M | 0.66GB |
31
+ | [lmlab-mistral-1b-untrained.Q4_1.gguf](https://huggingface.co/RichardErkhov/lmlab_-_lmlab-mistral-1b-untrained-gguf/blob/main/lmlab-mistral-1b-untrained.Q4_1.gguf) | Q4_1 | 0.69GB |
32
+ | [lmlab-mistral-1b-untrained.Q5_0.gguf](https://huggingface.co/RichardErkhov/lmlab_-_lmlab-mistral-1b-untrained-gguf/blob/main/lmlab-mistral-1b-untrained.Q5_0.gguf) | Q5_0 | 0.74GB |
33
+ | [lmlab-mistral-1b-untrained.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/lmlab_-_lmlab-mistral-1b-untrained-gguf/blob/main/lmlab-mistral-1b-untrained.Q5_K_S.gguf) | Q5_K_S | 0.74GB |
34
+ | [lmlab-mistral-1b-untrained.Q5_K.gguf](https://huggingface.co/RichardErkhov/lmlab_-_lmlab-mistral-1b-untrained-gguf/blob/main/lmlab-mistral-1b-untrained.Q5_K.gguf) | Q5_K | 0.76GB |
35
+ | [lmlab-mistral-1b-untrained.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/lmlab_-_lmlab-mistral-1b-untrained-gguf/blob/main/lmlab-mistral-1b-untrained.Q5_K_M.gguf) | Q5_K_M | 0.76GB |
36
+ | [lmlab-mistral-1b-untrained.Q5_1.gguf](https://huggingface.co/RichardErkhov/lmlab_-_lmlab-mistral-1b-untrained-gguf/blob/main/lmlab-mistral-1b-untrained.Q5_1.gguf) | Q5_1 | 0.8GB |
37
+ | [lmlab-mistral-1b-untrained.Q6_K.gguf](https://huggingface.co/RichardErkhov/lmlab_-_lmlab-mistral-1b-untrained-gguf/blob/main/lmlab-mistral-1b-untrained.Q6_K.gguf) | Q6_K | 0.87GB |
38
+ | [lmlab-mistral-1b-untrained.Q8_0.gguf](https://huggingface.co/RichardErkhov/lmlab_-_lmlab-mistral-1b-untrained-gguf/blob/main/lmlab-mistral-1b-untrained.Q8_0.gguf) | Q8_0 | 1.12GB |
39
+
40
+
41
+
42
+
43
+ Original model description:
44
+ ---
45
+ license: apache-2.0
46
+ language:
47
+ - en
48
+ pipeline_tag: text-generation
49
+ ---
50
+
51
+ Sorry everyone this got sort of popular but it doesnt generate understandable text - I think there's a way to make this generate good results w/ relatively little compute I'll experiment a bit later
52
+
53
+ # LMLab Mistral 1B Untrained
54
+
55
+ This is an untrained base model modified from Mistral-7B-Instruct. It has 1.13 billion parameters.
56
+
57
+ ## Untrained
58
+
59
+ This model is untrained. **This means it will not generate comprehensible text.**
60
+
61
+ ## Model Details
62
+
63
+ ### Model Description
64
+
65
+ - **Developed by:** LMLab
66
+ - **License:** Apache 2.0
67
+ - **Parameters:** 1.13 billion (1,134,596,096)
68
+ - **Modified from model:** [`mistralai/Mistral-7B-v0.1`](https://huggingface.co/mistralai/Mistral-7B-v0.1)
69
+
70
+ ### Model Architecture
71
+
72
+ LMLab Mistral 1B is a transformer model, with the following architecture choices:
73
+
74
+ * Grouped-Query Attention
75
+ * Sliding-Window Attention
76
+ * Byte-fallback BPE tokenizer
77
+
78
+ ## Usage
79
+
80
+ Use `MistralForCausalLM`.
81
+
82
+ ```python
83
+ from transformers import MistralForCausalLM, AutoTokenizer
84
+ tokenizer = AutoTokenizer.from_pretrained('lmlab/lmlab-mistral-1b-untrained')
85
+ model = MistralForCausalLM.from_pretrained('lmlab/lmlab-mistral-1b-untrained')
86
+ text = "Once upon a time"
87
+ encoded_input = tokenizer(text, return_tensors='pt')
88
+ output = model.generate(**encoded_input)
89
+ print(tokenizer.decode(output[0]))
90
+ ```
91
+
92
+ ## Notice
93
+
94
+ This model does not have any moderation systems.
95
+