zephyr-7B-beta-GGUF

Running

limcheekin commited on Oct 28, 2023

Commit

61a6da8

•

1 Parent(s): 575e725

feat: changed to zephyr-7B-beta-GGUF model

Files changed (4) hide show

Dockerfile CHANGED Viewed

@@ -15,7 +15,7 @@ RUN pip install -U pip setuptools wheel && \
 # Download model
 RUN mkdir model && \
-    curl -L https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGUF/resolve/main/mistral-7b-instruct-v0.1.Q4_K_M.gguf -o model/gguf-model.bin
 COPY ./start_server.sh ./
 COPY ./main.py ./

 # Download model
 RUN mkdir model && \
+    curl -L https://huggingface.co/TheBloke/zephyr-7B-beta-GGUF/resolve/main/zephyr-7b-beta.Q4_K_M.gguf -o model/gguf-model.bin
 COPY ./start_server.sh ./
 COPY ./main.py ./

README.md CHANGED Viewed

@@ -1,20 +1,20 @@
 ---
-title: Mistral-7B-Instruct-v0.1-GGUF (Q4_K_M)
 colorFrom: purple
 colorTo: blue
 sdk: docker
 models:
-  - mistralai/Mistral-7B-Instruct-v0.1
-  - TheBloke/Mistral-7B-Instruct-v0.1-GGUF
 tags:
   - inference api
   - openai-api compatible
   - llama-cpp-python
-  - Mistral-7B-Instruct-v0.1-GGUF
   - gguf
 pinned: false
 ---
-# Mistral-7B-Instruct-v0.1-GGUF (Q4_K_M)
 Please refer to the [index.html](index.html) for more information.

 ---
+title: zephyr-7B-beta-GGUF (Q4_K_M)
 colorFrom: purple
 colorTo: blue
 sdk: docker
 models:
+  - HuggingFaceH4/zephyr-7b-beta
+  - TheBloke/zephyr-7B-beta-GGUF
 tags:
   - inference api
   - openai-api compatible
   - llama-cpp-python
+  - zephyr-7B-beta-GGUF
   - gguf
 pinned: false
 ---
+# zephyr-7B-beta-GGUF (Q4_K_M)
 Please refer to the [index.html](index.html) for more information.

index.html CHANGED Viewed

@@ -1,10 +1,10 @@
 <!DOCTYPE html>
 <html>
   <head>
-    <title>Mistral-7B-Instruct-v0.1-GGUF (Q4_K_M)</title>
   </head>
   <body>
-    <h1>Mistral-7B-Instruct-v0.1-GGUF (Q4_K_M)</h1>
     <p>
       With the utilization of the
       <a href="https://github.com/abetlen/llama-cpp-python">llama-cpp-python</a>
@@ -16,27 +16,17 @@
     <ul>
       <li>
         The API endpoint:
-        <a href="https://limcheekin-mistral-7b-instruct-v0-1-gguf.hf.space/v1"
-          >https://limcheekin-mistral-7b-instruct-v0-1-gguf.hf.space/v1</a
         >
       </li>
       <li>
         The API doc:
-        <a href="https://limcheekin-mistral-7b-instruct-v0-1-gguf.hf.space/docs"
-          >https://limcheekin-mistral-7b-instruct-v0-1-gguf.hf.space/docs</a
         >
       </li>
     </ul>
-    <p>
-      Go ahead and try it out the API endpoint yourself with the
-      <a
-        href="https://huggingface.co/spaces/limcheekin/Mistral-7B-Instruct-v0.1-GGUF/blob/main/mistral-7b-instruct.ipynb"
-        target="_blank"
-      >
-        mistral-7b-instruct.ipynb</a
-      >
-      jupyter notebook.
-    </p>
     <p>
       If you find this resource valuable, your support in the form of starring
       the space would be greatly appreciated. Your engagement plays a vital role

 <!DOCTYPE html>
 <html>
   <head>
+    <title>zephyr-7B-beta-GGUF (Q4_K_M)</title>
   </head>
   <body>
+    <h1>zephyr-7B-beta-GGUF (Q4_K_M)</h1>
     <p>
       With the utilization of the
       <a href="https://github.com/abetlen/llama-cpp-python">llama-cpp-python</a>
     <ul>
       <li>
         The API endpoint:
+        <a href="https://limcheekin-zephyr-7b-beta-gguf.hf.space/v1"
+          >https://limcheekin-zephyr-7b-beta-gguf.hf.space/v1</a
         >
       </li>
       <li>
         The API doc:
+        <a href="https://limcheekin-zephyr-7b-beta-gguf.hf.space/docs"
+          >https://limcheekin-zephyr-7b-beta-gguf.hf.space/docs</a
         >
       </li>
     </ul>
     <p>
       If you find this resource valuable, your support in the form of starring
       the space would be greatly appreciated. Your engagement plays a vital role

mistral-7b-instruct.ipynb DELETED Viewed

The diff for this file is too large to render. See raw diff