Package: genoss
Genoss GPTOne line replacement for openAI ChatGPT & Embeddings powered by OSS modelsGenoss is a pioneering open-source initiative that aims to offer a seamless alternative to OpenAI models such as GPT 3.5 & 4, using open-source models like GPT4ALL.Project bootstrapped usingSicaratorFeaturesOpen-Source: Genoss is built on top of open-source models like GPT4ALL.One Line Replacement: Genoss is a one-line replacement for OpenAI ChatGPT API.DemoChat Completion and Embedding with GPT4ALLhttps://github.com/OpenGenenerativeAI/GenossGPT/assets/19614572/9cfd4f69-6396-4883-b94d-e94dd76663dcSupported ModelsGPT4ALL Model & EmbeddingsMore models coming soon!Starting UpBefore you embark, ensure Python 3.11 or higher is installed on your machine.Install the serverUsing pip (RECOMMENDED):warning: we are currently in prepublish.pipinstallgenossInstall the latest version from this repositorypipinstallgit+https://github.com/OpenGenerativeAI/GenossGPT.git@main\#egg\=genossRun the servergenoss-server# To know moregenoss-server--helpAccess the api docs viahttp://localhost:4321/docs.Models InstallationInstall GPT4ALL ModelThe first step is to install GPT4ALL, which is the only supported model at the moment. You can do this by following these steps:Clone the repository:gitclone--recurse-submodulesgit@github.com:nomic-ai/gpt4all.gitNavigate to the backend directory:cdgpt4all/gpt4all-backend/Create a new build directory and navigate into it:mkdirbuild&&cdbuildConfigure and build the project using cmake:cmake..
cmake--build.--parallelVerify that libllmodel.* exists ingpt4all-backend/build.Navigate back to the root and install the Python package:cd../../gpt4all-bindings/python
pip3install-e.Download it to your local machine fromhereand put it in thelocal_modelsdirectory aslocal_models/ggml-gpt4all-j-v1.3-groovy.binRunning the ApplicationYou need to installpoetryand a valid python version (3.11*).poetryinstallFor more, on a complete install for development purpose, you can check theCONTRIBUTING.md.
If you simply want to start the server, you can install with the corresponding poetry groups :poetryinstall--onlymain,llmsAfter the Python package has been installed, you can run the application. The Uvicorn ASGI server can be used to run your application:uvicornmain:app--host0.0.0.0--port4321This command launches the Genoss application on port 4321 of your machine.Running the Webapp DemoIn thedemo/cp.env.example.envReplace the values and thenPYTHONPATH=.streamlitrundemo/main.pyGenoss API UsageThe Genoss API is a one-line replacement for the OpenAI ChatGPT API. It supports the same parameters and returns the same response format as the OpenAI API.Simply replace the OpenAI API endpoint with the Genoss API endpoint and you're good to go!Modify the models to the supported list of models and you're good to go!You can find the API documentation at/docsor/redoc.Upcoming DevelopmentsWhile GPT4ALL is the only model currently supported, we are planning to add more models in the future. So, stay tuned for more exciting updates.The vision:Allow LLM models to be ran locallyAllow LLM to be ran locally using HuggingFaceALlow LLM to be ran on HuggingFace and just be a wrapper around the inference API.Allow easy installation of LLM models locallyAllow users to use cloud provider solutions such as GCP, AWS, Azure, etc ...Allow users management with API keysHave all kinds of models available for use (text to text, text to image, text to audio, audio to text, etc.)Be compatible with OpenAI API for models that are compatible with OpenAI APIHistoryGenoss was imagined byStan Girardwhen a feature ofQuivrbecame too big and complicated to maintain.The idea was to create a simple API that would allow to use any model with the same API as OpenAI's ChatGPT API.Then @mattzcarey, @MaximeThoonsen, @Wirgand @StanGirardstarted working on the project and it became a reality.ContributionsYour contributions to Genoss are immensely appreciated! Feel free to submit any issues or pull requests.Thanks go to these wonderful people:Sponsors ❤️This project could not be possible without the support of our sponsors. Thank you for your support!LicenseGenoss is licensed under the Apache2 License. For more details, refer to theLICENSEfile.