Spaces:
Runtime error
Apply for community grant: Academic project
Hi!
I would like to request a GPU grant for this online demo of my large language models for French 🇫🇷 instruction-following and chat. As far as I know, these are the first LLMs that have been fine-tuned specifically for following instructions and conducting multi-turn dialogues in French.
The LLMs have been trained using 🤗 Hugging Face's Transformers and the Peft library. The code and resources are available on the GitHub repository, and the models themselves can be accessed on the Huggingface Hub.
To make these models more accessible and facilitate evaluation and testing, I would like to provide an online demo where users can interact with the LLMs in real-time. This demo would be a valuable resource for the French community, especially for those interested in LLMs. This request has also been frequently mentioned within the community, as shown by link1, link2, and link3.
However, running the demo requires significant computational resources, and I do not currently have access to a GPU that would be powerful enough to handle the workload. Therefore, I am hoping to receive a GPU grant that would allow me to host the demo and provide a seamless user experience.
Thank you for considering my request for a GPU grant. I believe that this demo has the potential to greatly benefit the French community!
PS: The demo is currently offline due to a memory limit issue (16GB). However, the current code should run smoothly with a GPU