onoAI Basalt Model
Collection
3 items โข Updated
The primary workhorse coding and business reasoning engine of the OnoAI ecosystem.
Engineered for autonomous software engineering, full-stack Next.js/React development, OnoCloud ERP ledger logic (ZATCA Phase 2, IFRS), 3D game engines (Three.js/GLSL), and sovereign multi-turn chat.
q, k, v, o, gate, up, down)import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
base_model_name = "Qwen/Qwen2.5-Coder-32B-Instruct"
adapter_name = "onocloud/onoai-basalt-2.2-pro"
tokenizer = AutoTokenizer.from_pretrained(adapter_name)
base_model = AutoModelForCausalLM.from_pretrained(
base_model_name,
torch_dtype=torch.bfloat16,
device_map="auto"
)
model = PeftModel.from_pretrained(base_model, adapter_name)
model.eval()
prompt = "<|im_start|>system\nุฃูุช OnoAI Basalt 2.2 Proุ ุงูุนูู ุงูุณูุงุฏู ุงูู
ูุญุฏ ููุจุฑู
ุฌุฉ ูุงูู
ุนู
ุงุฑูุฉ ูู
ูุธูู
ุฉ ุณูู ุงููููุงุก.<|im_end|>\n<|im_start|>user\nุงูุชุจ ุฏุงูุฉ TypeScript ูุญุณุงุจ ุถุฑูุจุฉ ZATCA Phase 2 ู
ุชูุงููุฉ ู
ุน OnoCloud ERP.<|im_end|>\n<|im_start|>assistant\n"
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=1024, temperature=0.2, top_p=0.95)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
vllm serve Qwen/Qwen2.5-Coder-32B-Instruct \
--enable-lora \
--lora-modules basalt-pro=onocloud/onoai-basalt-2.2-pro \
--max-model-len 8192 \
--gpu-memory-utilization 0.90