NeonLLM

Runtime error

NeonLLM / vllm.sh

Added vllm deploy script

ad427b2 10 months ago

134 Bytes

	#!/bin/bash
	python -m vllm.entrypoints.openai.api_server --model neongeckocom/NeonLLM --max-model-len 8000 --port 5000 --api-key [...]