--- language: - zh license: apache-2.0 tasks: - text-generation ---

HuatuoGPT2-7B

GitHub | Our Paper
# Quick Start ```Python import torch from transformers import AutoModelForCausalLM, AutoTokenizer from transformers.generation.utils import GenerationConfig tokenizer = AutoTokenizer.from_pretrained("FreedomIntelligence/HuatuoGPT2-7B", use_fast=True, trust_remote_code=True) model = AutoModelForCausalLM.from_pretrained("FreedomIntelligence/HuatuoGPT2-7B", device_map="auto", torch_dtype=torch.bfloat16, trust_remote_code=True) model.generation_config = GenerationConfig.from_pretrained("FreedomIntelligence/HuatuoGPT2-7B") messages = [] messages.append({"role": "user", "content": "肚子疼怎么办?"}) response = model.HuatuoChat(tokenizer, messages) print(response) ```