Hello, may I know where can I get the embeddings for falcon-40b?
#61
by
kurtgan
- opened
I like to use the embeddings with FAISS to read local PDFs. I understand that there are embeddings for OpenAI and LLaMA but I can't find for falcon-40b.
Thank you!
AFAIK, the falcon models are text gen models and not embedding models. While somewhere in the network, you could get the embeddings at least conceptually, these models don't give a handle to get to those.
which models would support embeddings?
There are embedding-specific models such as instruct-xl (https://huggingface.co/hkunlp/instructor-xl) that one can use.