chandlerTSLabs commited on
Commit
676e902
1 Parent(s): 1ebcaa1

Add initial llamafile

Browse files
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.llamafile filter=lfs diff=lfs merge=lfs -text
.gitignore ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ *.gguf
2
+ *.log
README.md CHANGED
@@ -1,3 +1,10 @@
1
  ---
2
- license: cc-by-sa-4.0
3
  ---
 
 
 
 
 
 
 
 
1
  ---
2
+ license: apache-2.0
3
  ---
4
+ # Rocket 3B Llamafile
5
+ ## See [here](https://dev.to/timesurgelabs/llamafile-ai-integration-deployment-made-easy-44cg#how-to-use-llamafiles) for a guide on how to use llamafiles!
6
+ * Model Sources
7
+ + [pansophic/Rocket 3B](https://huggingface.co/pansophic/rocket-3B)
8
+ + [Rocket 3B GGUF](https://huggingface.co/TheBloke/rocket-3B-GGUF)
9
+ * Llamafile Source Code: [Mozilla-Ocho/llamafile](https://github.com/Mozilla-Ocho/llamafile)
10
+ + Built with [Llamafile `658b18a`](https://github.com/Mozilla-Ocho/llamafile/tree/658b18a2edfeaf021adaa33eb3b890b193a9a8ef).
rocket-3b.Q4_K_M-server.llamafile ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8bc0a09775a9969fc133552c69fc2b2148fa1fac14f78f84a8b4db66fe67f427
3
+ size 1713705053
rocket-3b.Q4_K_M.llamafile ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d05e5a61c0be878bb64cc3ee6bfb6c40f248d2216b2ae00ef9d9f48e56ada27
3
+ size 1713049197
rocket-3b.Q5_K_M-server.llamafile ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e0f593b23e77ed27d9168a9b78a80fc14668ec567d6fcaf709785347a162dda1
3
+ size 1998458973
rocket-3b.Q5_K_M.llamafile ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6398ab960b69c90bf4be8d74c049c5121e3536f7a9e97e802a6a9d283e421bf
3
+ size 1997803117