Instructions to use Jagneshdeveloper/Ekant-14b-small with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Jagneshdeveloper/Ekant-14b-small with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Jagneshdeveloper/Ekant-14b-small") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Jagneshdeveloper/Ekant-14b-small") model = AutoModelForCausalLM.from_pretrained("Jagneshdeveloper/Ekant-14b-small", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Jagneshdeveloper/Ekant-14b-small with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Jagneshdeveloper/Ekant-14b-small" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Jagneshdeveloper/Ekant-14b-small", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Jagneshdeveloper/Ekant-14b-small
- SGLang
How to use Jagneshdeveloper/Ekant-14b-small with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Jagneshdeveloper/Ekant-14b-small" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Jagneshdeveloper/Ekant-14b-small", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Jagneshdeveloper/Ekant-14b-small" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Jagneshdeveloper/Ekant-14b-small", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Jagneshdeveloper/Ekant-14b-small with Docker Model Runner:
docker model run hf.co/Jagneshdeveloper/Ekant-14b-small
๐ฎ๐ณ Ekant-14B-small (Agentic Reasoning Edition)
๐ Made in India ๐
๐ A High-Performance Specialist Model Fused with Deep Reasoning
Developed by Jagneshdeveloper
๐ License: Apache 2.0 | โ๏ธ Parameters: 14 Billion | ๐ป Focus: Elite Coding, Reasoning & Agents
๐ Overview
Ekant-14B-small is an advanced 14-billion parameter large language model proudly developed by Jagneshdeveloper. While initially initialized via custom-trained adapter matrices, this final artifact is a fully unquantized standalone model in true float16 precision.
Built on top of the powerful microsoft/phi-4 architecture, this model has been custom-engineered and cross-compiled across multiple advanced mathematical optimization passes (including SLERP and TIES multi-model fusion protocols) to integrate elite agentic logic with deep, multi-step validation tracking.
๐ฌ Fusing & Pipeline Lifecycle
This model was compiled under a strict resource-constrained hardware architecture using custom disk-free sharded watchdog pipelines to guarantee full float precision mapping without accuracy loss:
- LoRA Fine-Tuning: Initial specialized instruction sets were targeted and compiled into low-rank matrix sub-layers (
ekant-adapter). - Base Integration: Unquantized adapter weights were chemically baked directly back into the core 29.3GB
microsoft/phi-4tensor layers. - Vanilla Alignment: Merged via SLERP (Spherical Linear Interpolation) at a calibrated
0.6/0.4ratio back with the foundational base model to act as a stabilizing anchor and counteract catastrophic forgetting. - Deep Reasoning Injection: Fused via TIES (Trimming, Electing, and Merging) to combine our custom capabilities directly with reinforcement-learned o3-style logic pathways.
โก Key Capabilities
- ๐ง Deep Reasoning plus: Features integrated reflection traces, error self-correction blocks, and highly granular problem-solving structures.
- ๐ป Coding Specialist: Optimized to write, debug, analyze, and safely refactor high-complexity code structures across Python, JavaScript, C++, Rust, and Go.
- ๐ค Agentic Excellence: High structural accuracy for tool-use, functional api execution loops, and generating strictly formatted outputs (like complex JSON or nested system commands).
๐ Model Summary
- Model Name: Ekant-14B-small (Agentic Ultimate Edition)
- Developer: Jagneshdeveloper
- Base Architecture: Built on top of Microsoft Phi-4 (Phi3 For Causal LM Core Class)
- Parameters: 14 Billion (14B)
- License: Apache 2.0 (Permissive Open-Source)
- Primary Language: English (en)
๐ป Quick Start
You can quickly load and deploy Ekant-14B-small using the Hugging Face transformers library:
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
# Real repository target path verified on your profile
model_name = "Jagneshdeveloper/ultimate-Ekant-14b"
# Load the optimized tokenizer and model
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(
model_name,
device_map="auto",
torch_dtype=torch.float16,
trust_remote_code=True
)
# Test prompt for deep reasoning & agentic execution
prompt = "Write an optimized Python script to scrape website data dynamically, handle API authentication token refreshes, and format it into a structured JSON array."
inputs = tokenizer(prompt, return_tensors="pt").to("cuda")
outputs = model.generate(
**inputs,
max_new_tokens=512,
temperature=0.5,
do_sample=True,
pad_token_id=tokenizer.eos_token_id
)
print(tokenizer.decode(outputs, skip_special_tokens=True))
๐ ๏ธ Intended Uses & Limitations
Ideal Use Cases
- Building autonomous AI agents and automated API execution loops.
- Serving as a local or cloud-hosted programming and mathematical reasoning assistant.
- Handling multi-step logical text generation and complex data extraction tasks.
Limitations
- Standard 14B computing constraints apply; heavy inference calls may require sharding or quantization depending on available VRAM allocations.
- Users should verify complex logic outputs before running generated scripts straight into a live production workspace.
๐ค Attribution & Support
Created with โค๏ธ by Jagneshdeveloper in India. This model is distributed under the open and permissive Apache 2.0 License, providing full freedom for commercial deployment, modifications, and distributed derivatives.
Special credit and attribution are extended to Microsoft for their foundational open-weights research contributions (phi-4 and Phi-4-reasoning-plus), which served as the essential structural pillars and base anchors for this advanced mathematical crossover fusion project.
For feedback, feature requests, or collaborations, feel free to open a discussion in the community tab!
- Downloads last month
- 228