quantize-my-repo / README.md
mohanz's picture
Update README.md
833b7df verified
metadata
title: Quantize My Repo
emoji: 🔶
colorFrom: gray
colorTo: pink
sdk: docker
hf_oauth: true
hf_oauth_scopes:
  - read-repos
  - write-repos
  - manage-repos
pinned: false
failure_strategy: rollback

About this space

Produced by Antigma Labs

Follow Antigma Labs in X https://x.com/antigma_labs

Antigma's GitHub Homepage https://github.com/AntigmaLabs

Quantize your model

For now we only support GGUF format

Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference

To run this space locally:

  1. Login huggingface CLI: huggingface-cli login
  2. Run command: HF_TOKEN=$(cat ~/.cache/huggingface/token) docker compose up