File size: 884 Bytes
b585c7f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 |
# h2oGPT Packer Templates
These scripts help create images in public clouds that can then submitted to Azure/GCP Marketplace for commercial use.
### Packer Scripts
- Azure - `h2ogpt-azure.json`
- GCP - `h2ogpt-gcp.json`
### Provisioning Scripts
- `setup_environment.sh`
- Responsible for setting up CUDA, GCC, Nginx, Python
- `install_h2ogpt.sh`
- Responsible for setting up h2oGPT with its dependencies
- `h2oai-h2ogpt-4096-llama2-13b-chat.sh`
- Responsible for setting up default model h2oai-h2ogpt-4096-llama2-13b-chat with vLLM in port 80 via Nginx
- vLLM, h2oGPT and Nginx are executed through services
- Model is downloaded at the runtime
__Jenkins Pipeline__: http://jenkins.h2o.local:8080/job/build-h2ogpt-cloud-images/
### Notes:
- Since model is downloaded at the runtime after VM is provisioned it takes around 5 - 10 min start h2oGPT correctly
|