dolly_test_1 / bot.py
kuangren's picture
Create bot.py
ec840f2
import torch
from transformers import pipeline
generate_text = pipeline(model="databricks/dolly-v2-12b", torch_dtype=torch.bfloat16, trust_remote_code=True, device_map="auto")
generate_text("Explain to me the difference between nuclear fission and fusion.")