No module named 'triton'
Hi! Was loading up unsloth/gemma-7b-bnb-4bit and came across the following:
"""
ModuleNotFoundError Traceback (most recent call last)
in <cell line: 1>()
----> 1 from unsloth import FastLanguageModel
2 import torch
3 max_seq_length = 2048 # Choose any! We auto support RoPE Scaling internally!
4 dtype = None # None for auto detection. Float16 for Tesla T4, V100, Bfloat16 for Ampere+
5 load_in_4bit = True # Use 4bit quantization to reduce memory usage. Can be False.
/usr/local/lib/python3.10/dist-packages/unsloth/init.py in
99 if "SPACE_AUTHOR_NAME" not in os.environ and "SPACE_REPO_NAME" not in os.environ:
100
--> 101 import triton
102 libcuda_dirs = lambda: None
103 if Version(triton.version) >= Version("3.0.0"):
ModuleNotFoundError: No module named 'triton'
"""
Was solved by:
"""
!pip install --no-deps xformers "trl<0.9.0" peft accelerate bitsandbytes triton
"""
Oh sorry on the issue - we updated the installation instructions:
%%capture
# Installs Unsloth, Xformers (Flash Attention) and all other packages!
!pip install "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git"
# We have to check which Torch version for Xformers (2.3 -> 0.0.27)
from torch import __version__; from packaging.version import Version as V
xformers = "xformers==0.0.27" if V(__version__) < V("2.4.0") else "xformers"
!pip install --no-deps {xformers} trl peft accelerate bitsandbytes triton