README.md

metadata

title: Flan T5 Large Gradio
emoji: 🐨
colorFrom: indigo
colorTo: green
sdk: gradio
sdk_version: 3.29.0
app_file: app.py
pinned: false
license: bsd-3-clause

Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference

flan-t5-large-gradio

A gradio frontend for Google's Flan-T5 Large language model, can also be adjusted for other sizes.

The gradio frontend runs in the browser, and displays a chat-like interface for interacting with the language model.

To run

Install the dependencies: gradio, transformers, sentencepiece

Recommended to install: safetensors

Optionally also install: accelerate

Run with: python app.py

Optionally run with: accelerate launch app.py (this may or may not speed up your execution)

To use other size models

Modify lines 4-6, comment/uncomment to select a different model. Note that each model has different requirements for storage/RAM, the code as presently configured assumes sufficient RAM to load the entire model.

Additional info on loading large models is on the Hugging Face website, see also