如何使用其他大语言模型(dev分支测试中)
1. 先运行text-generation
git clone https://github.com/oobabooga/text-generation-webui.git
pip install accelerate bitsandbytes flexgen gradio llamacpp markdown numpy peft requests rwkv safetensors sentencepiece tqdm datasets git+https://github.com/huggingface/transformers
cd text-generation-webui
python download-model.py facebook/galactica-1.3b
python server.py --cpu --listen --listen-port 7860 --model facebook_galactica-1.3b
2. 修改config.py
LLM_MODEL = "TGUI:galactica-1.3b@localhost:7860"
3. 运行!
cd chatgpt-academic
python main.py