DrKlaus-7B-exl2 / README.md
bartowski's picture
Quant for 4.25
f5fcf5b verified
metadata
license: apache-2.0

DrKlaus-7B

image/webp

DrKlaus-7B is a SFT model made with AutoSloth by macadeliccc

Process

💻 Usage

!pip install -qU transformers

from transformers import AutoTokenizer, AutoModelForCausalLM, pipeline

model = "macadeliccc/DrKlaus-7B"
tokenizer = AutoTokenizer.from_pretrained(model)

# Example prompt
prompt = "Your example prompt here"

# Generate a response
model = AutoModelForCausalLM.from_pretrained(model)
pipeline = pipeline("text-generation", model=model, tokenizer=tokenizer)
outputs = pipeline(prompt, max_length=50, num_return_sequences=1)
print(outputs[0]["generated_text"])