File size: 690 Bytes
ce9f9a1 dd87728 8f8b1a3 2a75437 dd87728 ce9f9a1 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 |
# Setup
This is for the gcp vm. Mine came installed with python3.7 and cuda 11.3
### Create a venv
`python3 -m venv .venv`
`source .venv/bin/activate`
You may have to install python3-venv to the machine.
### Install
```
pip install -r requirements.txt
pip uninstall -r uninstall.txt
```
I had to uninstall some cuda stuff that torch installed to make this work.
# References
https://github.com/tloen/alpaca-lora
https://huggingface.co/docs/transformers/main/en/model_doc/llama#llama
https://huggingface.co/docs/transformers/index
https://github.com/salesforce/WikiSQL
https://github.com/huggingface/peft
https://arxiv.org/pdf/1910.13461.pdf
https://arxiv.org/pdf/1808.06226.pdf
|