How to chat with the Q-RWKV-6?
#3
by
ljy77777777
- opened
I m really interested in our model! But it is my first time to know about the RWKV-structure model, could you please provide the envs requirements and the code to chat with it? Thanks!
hi @ljy77777777 - this model is available for inference on Featherless.ai
Check out here: https://featherless.ai/models/recursal/QRWKV6-32B-Instruct-Preview-v0.1
We provide inference via OpenAI compatible API endpoints, so you can chat with it with just about any chat client (e.g. TypingMind, SillyTavern to name a few).
We also provide an basic in-browser client Phoenix for fast experimentation.