GitHub repository: pcompieta/basic-llm-wrapper-cli-flask
Primary language: Python
Created: 2023-11-08T12:10:51Z
Description: Basic LLM wrapper with 3 consumers: CLI, Flask, and load/scaling test. Works with HuggingFace models like Llama and TinyLlama (and others).