google-cloud

Getting Started

Hugging Face on Google Cloud Features & benefits Using TPUs on Google Cloud Other Resources

Deep Learning Containers (DLCs)

Introduction Available DLCs on Google Cloud

Examples

Vertex AI

Inference

Evaluation

Training

GKE

Inference

Training

Cloud Run

Inference

Join the Hugging Face community

and get access to the augmented documentation experience

Collaborate on models, datasets and Spaces

Faster examples with accelerated inference

Switch between documentation themes

to get started

(Preview) Cloud Run Examples

This directory contains usage examples of the Hugging Face Deep Learning Containers (DLCs) in Cloud Run only for inference at the moment, with a focus on Large Language Models (LLMs).

Inference Examples

Example	Title
deploy-gemma-2-on-cloud-run	Deploy Gemma2 9B with TGI DLC on Cloud Run
deploy-llama-3-1-on-cloud-run	Deploy Llama 3.1 8B with TGI DLC on Cloud Run

Training Examples

Coming soon!

📍 Find the complete example on GitHub here!

< > Update on GitHub

←Fine-tune Mistral 7B v0.3 with PyTorch Training DLC using SFT + LoRA on GKE Deploy Gemma2 9B with TGI DLC on Cloud Run→