Hugging Face's logo

Spaces:
winstxnhdw
/
llm-api
Running

App Files Community
winstxnhdw commited on
Commit
8373866
•
1 Parent(s): 673bc8d

fix: remove `caddy` to avoid violating HF ToS

Browse files
Files changed (2) hide show
  1. Dockerfile +5 -6
  2. README.md +1 -0
Dockerfile CHANGED
@@ -1,9 +1,8 @@
1
  FROM ghcr.io/winstxnhdw/llm-api:main
2
 
3
- ENV SERVER_PORT 5000
4
- ENV APP_PORT 7860
5
- ENV OMP_NUM_THREADS 8
6
- ENV CT2_USE_EXPERIMENTAL_PACKED_GEMM 1
7
- ENV CT2_FORCE_CPU_ISA AVX512
8
 
9
- EXPOSE $APP_PORT
 
1
  FROM ghcr.io/winstxnhdw/llm-api:main
2
 
3
+ ENV SERVER_PORT=7860
4
+ ENV OMP_NUM_THREADS=2
5
+ ENV CT2_USE_EXPERIMENTAL_PACKED_GEMM=1
6
+ ENV CT2_FORCE_CPU_ISA=AVX512
 
7
 
8
+ EXPOSE $SERVER_PORT
README.md CHANGED
@@ -5,6 +5,7 @@ colorFrom: pink
5
  colorTo: green
6
  sdk: docker
7
  pinned: false
 
8
  ---
9
 
10
  Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
5
  colorTo: green
6
  sdk: docker
7
  pinned: false
8
+ base_path: /api/docs
9
  ---
10
 
11
  Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference