| # h2oGPT Packer Templates | |
| These scripts help create images in public clouds that can then submitted to Azure/GCP Marketplace for commercial use. | |
| ### Packer Scripts | |
| - Azure - `h2ogpt-azure.json` | |
| - GCP - `h2ogpt-gcp.json` | |
| ### Provisioning Scripts | |
| - `setup_environment.sh` | |
| - Responsible for setting up CUDA, GCC, Nginx, Python | |
| - `install_h2ogpt.sh` | |
| - Responsible for setting up h2oGPT with its dependencies | |
| - `h2oai-h2ogpt-4096-llama2-13b-chat.sh` | |
| - Responsible for setting up default model h2oai-h2ogpt-4096-llama2-13b-chat with vLLM in port 80 via Nginx | |
| - vLLM, h2oGPT and Nginx are executed through services | |
| - Model is downloaded at the runtime | |
| __Jenkins Pipeline__: http://jenkins.h2o.local:8080/job/build-h2ogpt-cloud-images/ | |
| ### Notes: | |
| - Since model is downloaded at the runtime after VM is provisioned it takes around 5 - 10 min start h2oGPT correctly | |