Documents serverless motivation and testing instructions
5da2aef
Luke Stanleycommited on
Avoid unneeded imports, make serverless output more sensible, removing some debugging and comments
469f650
Luke Stanleycommited on
Fix RUNPOD_ENDPOINT_ID environment variable
ce5ad5f
Luke Stanleycommited on
Add more serverless GPU endpoint setup instruction detail
b51ce5c
Luke Stanleycommited on
Document serverless setup
f2e80c9
Luke Stanleycommited on
Rename serverless test file, set default model to Phi 2 for test, removed jq install, and env vars that are set the same in utils.py already, ignore .cache in git