Commit
•
676e902
1
Parent(s):
1ebcaa1
Add initial llamafile
Browse files- .gitattributes +1 -0
- .gitignore +2 -0
- README.md +8 -1
- rocket-3b.Q4_K_M-server.llamafile +3 -0
- rocket-3b.Q4_K_M.llamafile +3 -0
- rocket-3b.Q5_K_M-server.llamafile +3 -0
- rocket-3b.Q5_K_M.llamafile +3 -0
.gitattributes
CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
36 |
+
*.llamafile filter=lfs diff=lfs merge=lfs -text
|
.gitignore
ADDED
@@ -0,0 +1,2 @@
|
|
|
|
|
|
|
1 |
+
*.gguf
|
2 |
+
*.log
|
README.md
CHANGED
@@ -1,3 +1,10 @@
|
|
1 |
---
|
2 |
-
license:
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
+
license: apache-2.0
|
3 |
---
|
4 |
+
# Rocket 3B Llamafile
|
5 |
+
## See [here](https://dev.to/timesurgelabs/llamafile-ai-integration-deployment-made-easy-44cg#how-to-use-llamafiles) for a guide on how to use llamafiles!
|
6 |
+
* Model Sources
|
7 |
+
+ [pansophic/Rocket 3B](https://huggingface.co/pansophic/rocket-3B)
|
8 |
+
+ [Rocket 3B GGUF](https://huggingface.co/TheBloke/rocket-3B-GGUF)
|
9 |
+
* Llamafile Source Code: [Mozilla-Ocho/llamafile](https://github.com/Mozilla-Ocho/llamafile)
|
10 |
+
+ Built with [Llamafile `658b18a`](https://github.com/Mozilla-Ocho/llamafile/tree/658b18a2edfeaf021adaa33eb3b890b193a9a8ef).
|
rocket-3b.Q4_K_M-server.llamafile
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8bc0a09775a9969fc133552c69fc2b2148fa1fac14f78f84a8b4db66fe67f427
|
3 |
+
size 1713705053
|
rocket-3b.Q4_K_M.llamafile
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8d05e5a61c0be878bb64cc3ee6bfb6c40f248d2216b2ae00ef9d9f48e56ada27
|
3 |
+
size 1713049197
|
rocket-3b.Q5_K_M-server.llamafile
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e0f593b23e77ed27d9168a9b78a80fc14668ec567d6fcaf709785347a162dda1
|
3 |
+
size 1998458973
|
rocket-3b.Q5_K_M.llamafile
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e6398ab960b69c90bf4be8d74c049c5121e3536f7a9e97e802a6a9d283e421bf
|
3 |
+
size 1997803117
|