Can the embeddings created by the model used with OpenAI completion or chatCompletion API?
#1
by
limcheekin
- opened
Hi there,
Thanks for sharing the model.
Please advise the question on the title above.
Thank you.
Best regards.
Hi! Please note that this is only the tokenizer for the model, and does not contain any model weights, meaning it cannot be used for generating embeddings.
The main purpose of this repo was to be able to count the number of tokens that will be sent to the OpenAI API.
Xenova
changed discussion status to
closed