Embeddings
#11
by
shabaz
- opened
Would there be a way to release the embedding model?
Could you clarify? You can get embeddings from this model directly using the AutoModel API.
shabaz
changed discussion status to
closed
Hello , are we able take a model trained for text generation(BioGPT) and use it to produce embeddings that make sense, without further training? Are these generated embeddings can be used and have a meaning?
I tried to use biogpt to generate embeddings and perform similarity to find matches but its accuracy is very low as compare to models trained on self-alignment task for biomedical entities. I used this model to generate embeddings like any model using sentence transform code. Can we use this model for embedding at all? Can someone shed light if they managed to use it?