ToolBench-ToolLLaMA-2-7b-GGML

Runtime error

limcheekin commited on Aug 17, 2023

Commit

35f15e1

•

1 Parent(s): 2516e02

feat: updated to ToolBench-ToolLLaMA-2-7b.ggmlv3.q8_0 model

Files changed (3) hide show

Dockerfile CHANGED Viewed

@@ -15,7 +15,7 @@ RUN pip install -U pip setuptools wheel && \
 # Download model
 RUN mkdir model && \
-    curl -L https://huggingface.co/TheBloke/orca_mini_v3_13B-GGML/resolve/main/orca_mini_v3_13b.ggmlv3.q5_K_S.bin -o model/ggmlv3-model.bin
 COPY ./start_server.sh ./
 COPY ./main.py ./
@@ -32,4 +32,4 @@ ENV PORT=7860
 EXPOSE ${PORT}
 # Run the server start script
-CMD ["/bin/sh", "./start_server.sh"]

 # Download model
 RUN mkdir model && \
+    curl -L https://huggingface.co/s3nh/ToolBench-ToolLLaMA-2-7b-GGML/resolve/main/ToolBench-ToolLLaMA-2-7b.ggmlv3.q8_0.bin -o model/ggmlv3-model.bin
 COPY ./start_server.sh ./
 COPY ./main.py ./
 EXPOSE ${PORT}
 # Run the server start script
+CMD ["/bin/sh", "./start_server.sh"]

README.md CHANGED Viewed

@@ -1,20 +1,20 @@
 ---
-title: orca_mini_v3_13B-GGML (q5_K_S)
 colorFrom: purple
 colorTo: blue
 sdk: docker
 models:
-- TheBloke/orca_mini_v3_13B-GGML
 tags:
-- inference api
-- openai-api compatible
-- llama-cpp-python
-- orca_mini_v3_13B
-- ggml
 pinned: false
-duplicated_from: limcheekin/orca_mini_v3_13B-GGML
 ---
-# orca_mini_v3_13B-GGML (q5_K_S)
 Please refer to the [index.html](index.html) for more information.

 ---
+title: ToolBench-ToolLLaMA-2-7b-GGML (q8_0)
 colorFrom: purple
 colorTo: blue
 sdk: docker
 models:
+  - ToolBench/ToolLLaMA-2-7b
+  - s3nh/ToolBench-ToolLLaMA-2-7b-GGML
 tags:
+  - inference api
+  - openai-api compatible
+  - llama-cpp-python
+  - ToolLLaMA-2-7b
+  - ggml
 pinned: false
 ---
+# ToolBench-ToolLLaMA-2-7b-GGML (q8_0)
 Please refer to the [index.html](index.html) for more information.

index.html CHANGED Viewed

@@ -1,10 +1,10 @@
 <!DOCTYPE html>
 <html>
   <head>
-    <title>orca_mini_v3_13B-GGML (q5_K_S)</title>
   </head>
   <body>
-    <h1>orca_mini_v3_13B-GGML (q5_K_S)</h1>
     <p>
       With the utilization of the
       <a href="https://github.com/abetlen/llama-cpp-python">llama-cpp-python</a>
@@ -16,14 +16,14 @@
     <ul>
       <li>
         The API endpoint:
-        <a href="https://limcheekin-orca-mini-v3-13b-ggml.hf.space/v1"
-          >https://limcheekin-orca-mini-v3-13b-ggml.hf.space/v1</a
         >
       </li>
       <li>
         The API doc:
-        <a href="https://limcheekin-orca-mini-v3-13b-ggml.hf.space/docs"
-          >https://limcheekin-orca-mini-v3-13b-ggml.hf.space/docs</a
         >
       </li>
     </ul>

 <!DOCTYPE html>
 <html>
   <head>
+    <title>ToolBench-ToolLLaMA-2-7b-GGML (q8_0)</title>
   </head>
   <body>
+    <h1>ToolBench-ToolLLaMA-2-7b-GGML (q8_0)</h1>
     <p>
       With the utilization of the
       <a href="https://github.com/abetlen/llama-cpp-python">llama-cpp-python</a>
     <ul>
       <li>
         The API endpoint:
+        <a href="https://limcheekin-toolbench-toolllama-2-7b-ggml.hf.space/v1"
+          >https://limcheekin-toolbench-toolllama-2-7b-ggml.hf.space/v1</a
         >
       </li>
       <li>
         The API doc:
+        <a href="https://limcheekin-toolbench-toolllama-2-7b-ggml.hf.space/docs"
+          >https://limcheekin-toolbench-toolllama-2-7b-ggml.hf.space/docs</a
         >
       </li>
     </ul>