s3nh commited on
Commit
9a864a5
1 Parent(s): 43ab62f

Upload folder using huggingface_hub

Browse files
.gitattributes CHANGED
@@ -33,3 +33,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ wsb-gpt-7b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
37
+ wsb-gpt-7b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ wsb-gpt-7b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ wsb-gpt-7b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
40
+ wsb-gpt-7b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,74 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ ---
3
+ license: openrail
4
+ pipeline_tag: text-generation
5
+ library_name: transformers
6
+ language:
7
+ - zh
8
+ - en
9
+ ---
10
+
11
+
12
+ ## Original model card
13
+
14
+ Buy me a coffee if you like this project ;)
15
+ <a href="https://www.buymeacoffee.com/s3nh"><img src="https://www.buymeacoffee.com/assets/img/guidelines/download-assets-sm-1.svg" alt=""></a>
16
+
17
+ #### Description
18
+
19
+ GGUF Format model files for [This project](https://huggingface.co/Sentdex/WSB-GPT-7B).
20
+
21
+ ### GGUF Specs
22
+
23
+ GGUF is a format based on the existing GGJT, but makes a few changes to the format to make it more extensible and easier to use. The following features are desired:
24
+
25
+ Single-file deployment: they can be easily distributed and loaded, and do not require any external files for additional information.
26
+ Extensible: new features can be added to GGML-based executors/new information can be added to GGUF models without breaking compatibility with existing models.
27
+ mmap compatibility: models can be loaded using mmap for fast loading and saving.
28
+ Easy to use: models can be easily loaded and saved using a small amount of code, with no need for external libraries, regardless of the language used.
29
+ Full information: all information needed to load a model is contained in the model file, and no additional information needs to be provided by the user.
30
+ The key difference between GGJT and GGUF is the use of a key-value structure for the hyperparameters (now referred to as metadata), rather than a list of untyped values.
31
+ This allows for new metadata to be added without breaking compatibility with existing models, and to annotate the model with additional information that may be useful for
32
+ inference or for identifying the model.
33
+
34
+
35
+
36
+ ### inference
37
+
38
+
39
+ User: Tell me story about what is an quantization and what do we need to build. everyone on earth to use the internet
40
+
41
+ ### REPLY:
42
+ Quantization? Oh, you mean quantilization.
43
+
44
+ As for your second question... We need 5G!
45
+
46
+ ### END.
47
+
48
+ ### END.
49
+
50
+ ### END.
51
+
52
+ ### END.
53
+
54
+ ### END.
55
+
56
+ ### END.
57
+
58
+ ### END.
59
+
60
+ ### END.
61
+
62
+ ### END.
63
+
64
+ ### END.
65
+
66
+ ### END.
67
+
68
+ ### END.
69
+
70
+ ### END.
71
+
72
+ ### END
73
+
74
+ # Original model card
wsb-gpt-7b.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8db3de8c73caba2d95650014015fc78ab3153160798a21ef3004d01db35f7d59
3
+ size 2948304608
wsb-gpt-7b.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b2eeef2c757cd64764f52412751bb347f48a6f740e336f453c1bb89546874089
3
+ size 4081004256
wsb-gpt-7b.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ff393f82fc47bfdaa1b53b1276cf44ec8895b046625ce8ba221fb583414b38d
3
+ size 4783156960
wsb-gpt-7b.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:496bbb9fd578b4418090212a750650c9688846593f919825c471b871d33398d3
3
+ size 5529194208
wsb-gpt-7b.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0247dee5ad873dbe7a5fbdabf93de0e6cbe96f60840bed888903e5f5babf5f50
3
+ size 7161089760
wsb-gpt-7b.fp16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d06b8a0ad35f90d931b5741cfb881e0b820bea8fd71bb90396860cac9e1b51f3
3
+ size 13478104768