Hugging Face model: Dikshan1234/LLMPretrain
Author: Dikshan1234
Created: 2026-07-27 12:00:40
Last modified: 2026-07-29 14:39:50
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 0
Tags: transformers, safetensors, pretrained-from-scratch, causal-lm, gpt, rope, swiglu, grouped-query-attention, text-generation, en, dataset:HuggingFaceFW/fineweb-edu, license:cc-by-nc-4.0, endpoints_compatible, region:us
Card metadata:
license: cc-by-nc-4.0
datasets: HuggingFaceFW/fineweb-edu
language: en
tags: pretrained-from-scratch, causal-lm, gpt, rope, swiglu, grouped-query-attention
pipeline_tag: text-generation
library_name: transformers