Update "How to Use in `transformers`" to use `pipeline`
#18
by
mishig
HF staff
- opened
Update "How to Use in transformers" to use pipeline
cc: @osanseviero @pcuenq @ArthurZ wdyt?
if so, I can update the notebook as well
Looks good to me! What do you think about loading the pipeline directly and removing the model line and the AutoModelForCausalLM import?
generator = pipeline("text-generation", model=model_id, torch_dtype=dtype, device_map=device, tokenizer=tokenizer)
(Just an idea)