Spaces:
Configuration error
title: README
emoji: 😻
colorFrom: blue
colorTo: red
sdk: static
pinned: false
Rustformers - Large Language Models in Rust
Rustformers is a developer-centric initiative aiming to bring the robustness and efficiency of Rust to the world of large language models. At the core of this initiative is llm (Large Language Models), an ecosystem of Rust libraries specifically designed for handling and interacting with large language models.
About llm
llm is a set of Rust libraries that provide an interface for working with large language models. It is built on top of the fast, efficient GGML library for machine learning. llm includes support for various models such as BLOOM, GPT-2, GPT-J, GPT-NeoX, LLaMA, and MPT. The llm crate serves as a primary entry point for developers and also provides a CLI (Command Line Interface) for end users to interact with these models.
You can include llm in your Rust projects by listing it as a dependency in your Cargo.toml file. The package requires Rust v1.65.0 or above and a modern C toolchain for building. Detailed instructions on how to use llm in a Rust project and via the llm CLI are provided in the documentation.
Contact Us
llm, feel free to raise an issue on our GitHub repository or start a discussion. We are also available on Discord, where you can chat with us directly. We encourage contributions and look forward to your involvement in enhancing llm!
Further Reading
For more information, please refer to the documentation. The documentation provides an in-depth guide to using llm in your Rust projects, getting models, using the llm CLI, and answers to frequently asked questions.