Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
| # You can use any model that available to you and deployed on Hugging Face with compatible API | |
| # X_NAME variables are optional for HuggingFace API you can use them for your convenience | |
| # Make sure your key has permission to use all models | |
| # Set up you key here: https://huggingface.co/docs/api-inference/en/quicktour#get-your-api-token | |
| HF_API_KEY=hf_YOUR_HUGGINGFACE_API_KEY | |
| # For example you can try public Inference API endpoint for Meta-Llama-3-70B-Instruct model | |
| # This model quiality is comparable with GPT-4 | |
| # But public API has strict limit for output tokens, so it is very hard to use it for this usecase | |
| # You can use your private API endpoint for this model | |
| # Or use any other Hugging Face model that supports Messages API | |
| # Don't forget to add '/v1' to the end of the URL | |
| LLM_URL=https://api-inference.huggingface.co/models/meta-llama/Meta-Llama-3-70B-Instruct/v1 | |
| LLM_TYPE=HF_API | |
| LLM_NAME=Meta-Llama-3-70B-Instruct | |
| # The Open AI whisper family with more models is available on HuggingFace: | |
| # https://huggingface.co/collections/openai/whisper-release-6501bba2cf999715fd953013 | |
| # You can also use any other compatible STT model from HuggingFace | |
| STT_URL=https://api-inference.huggingface.co/models/openai/whisper-tiny.en | |
| STT_TYPE=HF_API | |
| STT_NAME=whisper-tiny.en | |
| # You can use compatible TTS model from HuggingFace | |
| # For example you can try public Inference API endpoint for Facebook MMS-TTS model | |
| # In my experience OS TTS models from HF sound much more robotic than OpenAI TTS models | |
| TTS_URL=https://api-inference.huggingface.co/models/facebook/mms-tts-eng | |
| TTS_TYPE=HF_API | |
| TTS_NAME=Facebook-mms-tts-eng | |