Hugging Face model: tjarvis91/qovaryx-3b-scratch-base
Author: tjarvis91
Created: 2026-06-04 08:59:54
Last modified: 2026-06-05 09:26:44
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 4
Tags: transformers, qovaryx_finance_decoder, pretraining, from-scratch, random-init, scratch-base, decoder, causal-lm, causal-language-model, transformer, compact-llm, compact-ai, sovereign-ai, sovereign-3b, 3b, 3-billion-parameters, consumer-gpu, local-ai, on-device, edge-ai, a100, a100-80gb, single-gpu-pretrain, rtx-5090, rtx-4090, rtx-5070-ti, small-language-model, medium-sized-llm, nanogpt, pretraining-template, mtp, multi-token-prediction, gqa, grouped-query-attention, swiglu, ternary-swiglu, bitnet, moe, mixture-of-experts, sparse-moe, low-rank, flash-attention-2, blackwell, sm120, pytorch, own-base, text-generation, en, license:apache-2.0, region:us
Card metadata:
license: apache-2.0
language: en
library_name: transformers
pipeline_tag: text-generation
inference: no
tags: pretraining, from-scratch, random-init, scratch-base, decoder, causal-lm, causal-language-model, transformer, compact-llm, compact-ai, sovereign-ai, sovereign-3b, 3b, 3-billion-parameters, consumer-gpu, local-ai, on-device, edge-ai, a100, a100-80gb, single-gpu-pretrain, rtx-5090, rtx-4090, rtx-5070-ti, small-language-model, medium-sized-llm, nanogpt, pretraining-template, mtp, multi-token-prediction, gqa, grouped-query-attention, swiglu, ternary-swiglu, bitnet, moe, mixture-of-experts, sparse-moe, low-rank, flash-attention-2, blackwell, sm120, pytorch, own-base