Spaces:
Sleeping
Sleeping
File size: 1,615 Bytes
c37b091 44800eb c37b091 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 |
# You can use any model that available to you and deployed on Hugging Face with compatible API
# X_NAME variables are optional for HuggingFace API you can use them for your convenience
# Make sure your key has permission to use all models
# Set up you key here: https://huggingface.co/docs/api-inference/en/quicktour#get-your-api-token
HF_API_KEY=hf_YOUR_HUGGINGFACE_API_KEY
# For example you can try public Inference API endpoint for Meta-Llama-3-70B-Instruct model
# This model quiality is comparable with GPT-4
# But public API has strict limit for output tokens, so it is very hard to use it for this usecase
# You can use your private API endpoint for this model
# Or use any other Hugging Face model that supports Messages API
# Don't forget to add '/v1' to the end of the URL
LLM_URL=https://api-inference.huggingface.co/models/meta-llama/Meta-Llama-3-70B-Instruct/v1
LLM_TYPE=HF_API
LLM_NAME=Meta-Llama-3-70B-Instruct
# The Open AI whisper family with more models is available on HuggingFace:
# https://huggingface.co/collections/openai/whisper-release-6501bba2cf999715fd953013
# You can also use any other compatible STT model from HuggingFace
STT_URL=https://api-inference.huggingface.co/models/openai/whisper-tiny.en
STT_TYPE=HF_API
STT_NAME=whisper-tiny.en
# You can use compatible TTS model from HuggingFace
# For example you can try public Inference API endpoint for Facebook MMS-TTS model
# In my experience OS TTS models from HF sound much more robotic than OpenAI TTS models
TTS_URL=https://api-inference.huggingface.co/models/facebook/mms-tts-eng
TTS_TYPE=HF_API
TTS_NAME=Facebook-mms-tts-eng
|