Hugging Face model: tjarvis91/qovaryx-50m-scratch-base
Author: tjarvis91
Created: 2026-05-23 07:28:56
Last modified: 2026-06-05 09:26:42
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 15
Tags: transformers, pytorch, qovaryx, text-generation, pretraining, from-scratch, random-init, scratch-base, decoder, causal-lm, causal-language-model, transformer, compact-llm, compact-ai, consumer-gpu, local-ai, on-device, edge-ai, 16gb-vram, rtx-4090, rtx-5090, rtx-5070-ti, small-language-model, tiny-llm, nanogpt, pretraining-template, mtp, multi-token-prediction, gqa, grouped-query-attention, swiglu, ternary-swiglu, bitnet, moe, mixture-of-experts, sparse-moe, low-rank, flash-attention-2, blackwell, sm120, own-base, sovereign-ai, custom_code, en, license:apache-2.0, region:us
Card metadata:
license: apache-2.0
language: en
library_name: transformers
pipeline_tag: text-generation
inference: no
tags: pretraining, from-scratch, random-init, scratch-base, decoder, causal-lm, causal-language-model, transformer, compact-llm, compact-ai, consumer-gpu, local-ai, on-device, edge-ai, 16gb-vram, rtx-4090, rtx-5090, rtx-5070-ti, small-language-model, tiny-llm, nanogpt, pretraining-template, mtp, multi-token-prediction, gqa, grouped-query-attention, swiglu, ternary-swiglu, bitnet, moe, mixture-of-experts, sparse-moe, low-rank, flash-attention-2, blackwell, sm120, pytorch, own-base, sovereign-ai