Hugging Face's logo

Spaces:
MBZUAI
/
Phi-3-V
Running on T4

App Files Community
1
Phi-3-V / docs /Windows.md
mmaaz60's picture
mmaaz60
Adds code to host LLaVA-Phi-3 demo on HF space.
5920b49
preview code
|
raw
history blame
957 Bytes

Run LLaVA on Windows

NOTE: LLaVA on Windows is not fully supported. Currently we only support 16-bit inference. For a more complete support, please use WSL2 for now. More functionalities on Windows is to be added soon, stay tuned.

Installation

  1. Clone this repository and navigate to LLaVA folder
git clone https://github.com/haotian-liu/LLaVA.git
cd LLaVA
  1. Install Package
conda create -n llava python=3.10 -y
conda activate llava
python -m pip install --upgrade pip  # enable PEP 660 support
pip install torch==2.0.1+cu117 torchvision==0.15.2+cu117 torchaudio==2.0.2 --index-url https://download.pytorch.org/whl/cu117
pip install -e .
pip uninstall bitsandbytes

Run demo

See instructions here.

Note that quantization (4-bit, 8-bit) is NOT supported on Windows. Stay tuned for the 4-bit support on Windows!