LeroyDyer/Mixtral_AI_PsycoTron

SOMETIME THEY WORK BETTER ON GPT4ALL as LMStudio is 50/50

Undergoing Psycological Training For its role as ...... Experimental only - works fine delete the config put new

! pip install flash_attn
from transformers import AutoModelForTokenClassification, AutoTokenizer
import torch

# Load pre-trained model and tokenizer
model_name = "LeroyDyer/Mixtral_AI_TokenClassification"
tokenizer = AutoTokenizer.from_pretrained("LeroyDyer/Mixtral_AI_PsycoTron")
model = AutoModelForTokenClassification.from_pretrained(model_name, 
                                                        trust_remote_code=True,
                                                        num_labels=3)
model
model.train

# Get loss or logits
# loss = outputs.loss
# logits = outputs.logits