How to use valine/ggv9 with Transformers:
# Load model directly from transformers import AutoTokenizer, SplitAttentionForCasualLM tokenizer = AutoTokenizer.from_pretrained("valine/ggv9") model = SplitAttentionForCasualLM.from_pretrained("valine/ggv9", device_map="auto")
· Sign up or log in to comment
