Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Spaces:
Duplicated from
neongeckocom/NeonLLM
neondaniel
/
NeonLLM
like
0
Runtime error
App
Files
Files
Community
Fetching metadata from the HF Docker repository...
NeonBohdan
commited on
May 12, 2024
Commit
ad427b2
·
1 Parent(s):
63a5c24
Added vllm deploy script
Browse files
Files changed (1)
hide
show
vllm.sh
+2
-0
vllm.sh
ADDED
Viewed
@@ -0,0 +1,2 @@
1
+
#!/bin/bash
2
+
python -m vllm.entrypoints.openai.api_server --model neongeckocom/NeonLLM --max-model-len 8000 --port 5000 --api-key [...]