limcheekin commited on
Commit
bba9598
1 Parent(s): 237b081

feat: updated BakLLaVA-1-GGUF model

Browse files
Files changed (3) hide show
  1. Dockerfile +2 -2
  2. README.md +3 -3
  3. index.html +2 -2
Dockerfile CHANGED
@@ -15,8 +15,8 @@ RUN pip install -U pip setuptools wheel && \
15
 
16
  # Download model
17
  RUN mkdir model && \
18
- curl -L https://huggingface.co/abetlen/BakLLaVA-1-GGUF/resolve/main/bakllava-1.Q6_K.gguf -o model/gguf-model.bin && \
19
- curl -L https://huggingface.co/abetlen/BakLLaVA-1-GGUF/resolve/main/mmproj-model-f16.gguf -o model/clip-model.bin
20
 
21
  COPY ./start_server.sh ./
22
  COPY ./main.py ./
 
15
 
16
  # Download model
17
  RUN mkdir model && \
18
+ curl -L https://huggingface.co/mys/ggml_bakllava-1/resolve/main/ggml-model-q5_k.gguf -o model/gguf-model.bin && \
19
+ curl -L https://huggingface.co/mys/ggml_bakllava-1/resolve/main/mmproj-model-f16.gguf -o model/clip-model.bin
20
 
21
  COPY ./start_server.sh ./
22
  COPY ./main.py ./
README.md CHANGED
@@ -1,11 +1,11 @@
1
  ---
2
- title: BakLLaVA-1-GGUF (Q6_K)
3
  colorFrom: purple
4
  colorTo: blue
5
  sdk: docker
6
  models:
7
  - SkunkworksAI/BakLLaVA-1
8
- - abetlen/BakLLaVA-1-GGUF
9
  tags:
10
  - inference api
11
  - openai-api compatible
@@ -15,6 +15,6 @@ tags:
15
  pinned: false
16
  ---
17
 
18
- # BakLLaVA-1-GGUF (Q6_K)
19
 
20
  Please refer to the [index.html](index.html) for more information.
 
1
  ---
2
+ title: BakLLaVA-1-GGUF (Q5_K)
3
  colorFrom: purple
4
  colorTo: blue
5
  sdk: docker
6
  models:
7
  - SkunkworksAI/BakLLaVA-1
8
+ - mys/ggml_bakllava-1
9
  tags:
10
  - inference api
11
  - openai-api compatible
 
15
  pinned: false
16
  ---
17
 
18
+ # BakLLaVA-1-GGUF (Q5_K)
19
 
20
  Please refer to the [index.html](index.html) for more information.
index.html CHANGED
@@ -1,10 +1,10 @@
1
  <!DOCTYPE html>
2
  <html>
3
  <head>
4
- <title>BakLLaVA-1-GGUF (Q6_K)</title>
5
  </head>
6
  <body>
7
- <h1>BakLLaVA-1-GGUF (Q6_K)</h1>
8
  <p>
9
  With the utilization of the
10
  <a href="https://github.com/abetlen/llama-cpp-python">llama-cpp-python</a>
 
1
  <!DOCTYPE html>
2
  <html>
3
  <head>
4
+ <title>BakLLaVA-1-GGUF (Q5_K)</title>
5
  </head>
6
  <body>
7
+ <h1>BakLLaVA-1-GGUF (Q5_K)</h1>
8
  <p>
9
  With the utilization of the
10
  <a href="https://github.com/abetlen/llama-cpp-python">llama-cpp-python</a>