self-chat / README.md
xu song
update
726a01e
|
raw
history blame
604 Bytes
metadata
title: Self Chat
emoji: 💬
colorFrom: yellow
colorTo: purple
sdk: gradio
sdk_version: 4.39.0
app_file: app.py
pinned: false
license: apache-2.0

An example chatbot using Gradio, huggingface_hub, and the Hugging Face Inference API.

安装问题

直接从源码安装,推理速度较慢,因此加入以下参数。

pip install git+https://github.com/abetlen/llama-cpp-python.git -C cmake.args="-DGGML_BLAS=ON;-DGGML_BLAS_VENDOR=OpenBLAS"