Sovereign STEM SLMs & MoE Architectures
Collection
Official flagship Sparse Mixture-of-Experts and ternary 1.58-bit SLMs engineered for offline STEM intelligence. β’ 11 items β’ Updated
Developed by Vigyan AI in Varanasi, Uttar Pradesh, India.
Vigyan-2B-STEM-Instruct-v1 is India's sovereign edge Small Language Model (SLM) engineered specifically for low-latency, edge-deployable STEM reasoning.
At ~2.4 billion parameters, it delivers:
<tool_call>) for exact arithmetic calculations.Run the 2B edge model live on free Google Colab hardware with zero local setup:
import torch
from transformers import AutoTokenizer, AutoModelForCausalLM, BitsAndBytesConfig
from peft import PeftModel
BASE_MODEL = "shreyansh12183/Shreyansh-STEM-AI-2B-v3"
ADAPTER = "shreyansh12183/Vigyan-2B-STEM-Instruct-v1"
# 1. Load Tokenizer
tokenizer = AutoTokenizer.from_pretrained(ADAPTER, trust_remote_code=True)
# 2. 4-bit Quantization Config (Runs on any laptop GPU with < 2GB VRAM)
bnb_config = BitsAndBytesConfig(
load_in_4bit=True,
bnb_4bit_quant_type="nf4",
bnb_4bit_compute_dtype=torch.float16,
bnb_4bit_use_double_quant=True
)
# 3. Load Model
base_model = AutoModelForCausalLM.from_pretrained(
BASE_MODEL,
quantization_config=bnb_config,
device_map="auto",
torch_dtype=torch.float16
)
model = PeftModel.from_pretrained(base_model, ADAPTER)
model.eval()
# 4. Prompt
prompt = "<|im_start|>user\nCalculate the equivalent resistance of 150 ohms and 300 ohms in parallel.<|im_end|>\n<|im_start|>assistant\n"
inputs = tokenizer(prompt, return_tensors="pt").to("cuda")
with torch.no_grad():
outputs = model.generate(**inputs, max_new_tokens=256, do_sample=False)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
This model is released under the Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0) license.
Base model
shreyansh12183/Shreyansh-STEM-AI-2B-v3