Duplicated from kepom/Kimi-K3-Abliterated-V1
How to use SHSLab/Kimi-K3-Abliterated with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("SHSLab/Kimi-K3-Abliterated", trust_remote_code=True, device_map="auto")
bro i dont have nasa super computer for this model
How do you even load this model like how good of a device gpu do you have
· Sign up or log in to comment
