# Setup
This is for the gcp vm.  Mine came installed with python3.7 and cuda 11.3
### Create a venv
`python3 -m venv .venv`  
`source .venv/bin/activate`
You may have to install python3-venv to the machine.
### Install 
```
pip install -r requirements.txt
pip uninstall -r uninstall.txt
```
I had to uninstall some cuda stuff that torch installed to make this work.

# References
https://github.com/tloen/alpaca-lora
https://huggingface.co/docs/transformers/main/en/model_doc/llama#llama
https://huggingface.co/docs/transformers/index
https://github.com/salesforce/WikiSQL


https://arxiv.org/pdf/1910.13461.pdf
https://arxiv.org/pdf/1808.06226.pdf