Apply for community grant: Personal project (gpu)

#1
by masonbarnes - opened

Open LLM search is a custom-tuned Llama 7B model designed to compile text from multiple live search results into a few concise paragraphs. It's completely open-source and a great alternative to Bing, Perplexity, or Bard. Self-hosting the model has become too expensive and we've had to turn off the model for now. We are in desperate need of a small GPU that can run a 7B large language model (~13 GB).

Help would be very appreciated!

image (1).png

Sign up or log in to comment