YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Use a pipeline as a high-level helper
from transformers import pipeline
messages = [ {"role": "user", "content": "Who are you?"}, ] pipe = pipeline("text-generation", model="shenzhi-wang/Llama3-8B-Chinese-Chat") pipe(messages)
Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("shenzhi-wang/Llama3-8B-Chinese-Chat") model = AutoModelForCausalLM.from_pretrained("shenzhi-wang/Llama3-8B-Chinese-Chat")
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support