AWS Trainium & Inferentia documentation

Notebooks

Hugging Face's logo
Join the Hugging Face community

and get access to the augmented documentation experience

to get started

Notebooks

We prepared some notebooks for you, so that you can run directly tutorials in the documentation.

Training

Notebook Description Studio Lab
Fine-tune BERT for text classification on AWS Trainium Show how to fine-tune BERT on AWS Trainium for text classification. Open in AWS Studio

Inference

Notebook Description Studio Lab
Create your own chatbot with llama-2-13B on AWS Inferentia Show how to run LLama-2 13B chat model on AWS inferentia 2. Open in AWS Studio
How to generate images with Stable Diffusion Show how to use stable-diffusion v2.1 model to generate images from prompts on Inferentia 2. Open in AWS Studio
How to generate images with Stable Diffusion XL Show how to use stable-diffusion XL model to generate images from prompts on Inferentia 2. Open in AWS Studio
Compute text embeddings with Sentence Transformers on Inferentia Show how to use Sentence Transformers to compute sentence / text embeddings on Inferentia 2. Open in AWS Studio
How to compile (if needed) and generate text with CodeLlama 7B How to use CodeLlama 7B to generate code. Also walks through compilation. Open in AWS Studio