Hugging Face's logo

Spaces:
lukestanley
/
ChillTranslator
Sleeping

App Files Community
1
ChillTranslator / utils.py

Commit History

Avoid unneeded imports, make serverless output more sensible, removing some debugging and comments
469f650

Luke Stanley commited on

Fix RUNPOD_ENDPOINT_ID environment variable
ce5ad5f

Luke Stanley commited on

Introduces worker mode env var
56e785c

Luke Stanley commited on

Ensure N_GPU_LAYERS is int
9475016

Luke Stanley commited on

Update default GPU layer, temperature values
e327a9e

lukestanley commited on

Add env vars to set GPU layer count and context size, make verbose
e01e28e

lukestanley commited on

Add n_gpu_layers parameter to Llama initialization
88e6118

lukestanley commited on

Fix: Move n_ctx parameter to model setup!
358cd20

lukestanley commited on

Fix check for LLM_MODEL_PATH to avoid load error
ff938c3

lukestanley commited on

Auto-downloads model if env var is not set
74d6e52

Luke Stanley commited on

Make llm_stream_sans_network actually stream to stdout
a0f49a0

Luke Stanley commited on

Default to in-memory LLM interface
ddb0d91

Luke Stanley commited on

Add comment about adaptability
6c32632

lukestanley commited on

Print new line after LLM output end and some linting
3ebb6e1

lukestanley commited on

Makes URL more obvious, update comments, lowers temp
a96b492

lukestanley commited on

Move prompt strings and types to own file, reorder code a bit
139217d

lukestanley commited on

Removed unused lines
f84c1a6

lukestanley commited on

Slight refactor tidying
327982a

lukestanley commited on