🚀 OpenCreate Ai v1 - Edge AI Model
OpenCreate Ai v1 is a lightweight, local Edge AI model implementation written entirely in Rust. It features a custom-built architecture including a Tokenizer, Embedding Matrix, Self-Attention mechanism, and Next-Token Prediction pipeline designed for efficient text and code generation on edge devices.
🛠️ Model Architecture
The model consists of four core modular layers implemented from scratch in Rust:
1. Custom Tokenizer
- Builds a vocabulary directly from the training corpus.
- Handles text encoding (string to token IDs) and decoding (token IDs back to text).
2. Embedding Layer
- Transforms token IDs into dense mathematical vectors (
vocab_size × embedding_dim) using custom weights.
3. Self-Attention Mechanism
- Captures contextual relationships and dependencies between tokens for basic reasoning and comprehension.
4. Prediction Layer (Linear / Next-Token)
- Computes context vectors to predict and generate the next sequential token for text writing or code completion.
5. Document & Search Pipeline
- Local search indexing and text output processing pipeline.
💻 Getting Started (Local Run)
Ensure you have Rust & Cargo installed on your system.
1. Clone the repository / Open project folder
cd OpenCreateAI
2. Run the model via Cargo
cargo run
📊 Sample Output
When executed locally, the model processes prompts and generates tokens as follows:
==================================================
OpenCreate Ai v1 - Edge AI Model Initialized
==================================================
[1] Tokenization Process:
Input Prompt : OpenCreate
Encoded IDs : [0, 1, 2, 3, 4, 5, 2, 6, 7, 2]
[2] Embedding Matrix Generated successfully.
[3] Self-Attention Mechanism Applied (Reasoning active).
[4] Generation & Output Result:
Generated Output Text/Code : OpenCreatea
[5] Document & Search Pipeline:
Status: Local Search Indexing & Document Export Ready.
==================================================
📄 License
This project is licensed under the OpenRAIL (Open Responsible AI License). By using, downloading, or modifying this model, you agree to comply with the terms and conditions promoting safe, responsible, and ethical AI deployment.
| Meta Info | Value |
|---|---|
| License | openrail |
| Language | en |
| Tags | rust, edge-ai, custom-model, tokenizer, self-attention |
Project Structure
OpenCreateAI/
├── Cargo.toml
├── src/
│ ├── main.rs
│ ├── tokenizer.rs
│ ├── embedding.rs
│ ├── attention.rs
│ ├── prediction.rs
│ └── search.rs
└── data/
└── corpus.txt