titanml/takeoff: TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models accessible to everyone.
A server designed for optimized inference of large language models
Category: llm
Language: HTML
Topics: deployment, inference, language-model, llama, llm, quantization
Homepage: https://docs.titanml.co/