NeonBohdan commited on
Commit
ad427b2
1 Parent(s): 63a5c24

Added vllm deploy script

Browse files
Files changed (1) hide show
  1. vllm.sh +2 -0
vllm.sh ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ #!/bin/bash
2
+ python -m vllm.entrypoints.openai.api_server --model neongeckocom/NeonLLM --max-model-len 8000 --port 5000 --api-key [...]