Inference Endpoints (dedicated) documentation

Security & Compliance

Hugging Face's logo
Join the Hugging Face community

and get access to the augmented documentation experience

to get started

Security & Compliance

πŸ€— Inference Endpoints is built with security and secure inference at its core. Below you can find an overview of the security measures we have in place.

Data Security/Privacy

Hugging Face does not store any customer data in terms of payloads or tokens that are passed to the Inference Endpoint. We are storing logs for 30 days. Every Inference Endpoints uses TLS/SSL to encrypt the data in transit.

We also recommend using AWS or Azure Private Link for organizations. This allows you to access your Inference Endpoint through a private connection, without exposing it to the internet.

Hugging Face also offers Business Associate Addendum or GDPR data processing agreement through the Inference Endpoint enterprise plan.

Model Security/Privacy:

You can set a model repository as private if you do not want to publicly expose it. Hugging Face does not own any model or data you upload to the Hugging Face hub. Hugging Face does provide malware and pickle scans over the contents of the model repository as with all items in the Hub.

Inference Endpoints and Hub Security

The Hugging Face Hub, which Inference Endpoints is part, is also SOC2 Type 2 certified. The Hugging Face Hub offers Role Based Access Control. For more on hub security: https://huggingface.co/docs/hub/security

Inference Endpoint Security level

We currently offer three types of endpoints, in order or increasing security level:

  • Public: A Public Endpoint is available from the internet, secured with TLS/SSL, and requires no authentication.
  • Protected: A Protected Endpoint is available from the internet, secured with TLS/SSL, and requires a valid Hugging Face token for authentication.
  • Private A Private Endpoint is only available through an intra-region secured AWS or Azure PrivateLink connection. Private Endpoints are not accessible from the internet.

Public and Protected Endpoints do not require any additional configuration. For Private Endpoints, you need to provide the AWS account ID of the account which also should have access to πŸ€— Inference Endpoints.

endpoint types

Hugging Face Privacy Policy - https://huggingface.co/privacy