Hugging Face model: ubitech-edg/commandr-35b-cpt
Author: ubitech-edg
Created: 2025-10-19 05:32:18
Last modified: 2025-10-19 07:13:49
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 5
Tags: transformers, safetensors, cohere, text-generation, causal-lm, continual-pretraining, lora, axolotl, deepspeed, commandr, eu-hpc, conversational, en, dataset:arxiv, dataset:gov, dataset:news, dataset:wikipedia, base_model:CohereLabs/c4ai-command-r-v01, base_model:adapter:CohereLabs/c4ai-command-r-v01, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Base model relation: adapter
Base models: id: CohereLabs/c4ai-command-r-v01
Card metadata:
language: en
license: apache-2.0
tags: text-generation, causal-lm, continual-pretraining, lora, axolotl, deepspeed, transformers, commandr, cohere, eu-hpc
datasets: arxiv, gov, news, wikipedia
metrics: loss
library_name: transformers
framework: pytorch
base_model: CohereLabs/c4ai-command-r-v01
model_name: commandr-35b-cpt
pipeline_tag: text-generation
task_categories: text-generation
model_type: AutoModelForCausalLM
inference: parameters: max_new_tokens: 512
temperature: 0.7
top_p: 0.9
trained_on: Leonardo EuroHPC
description: Continual pretraining (CPT) of Cohere Command-R 35B using Axolotl and DeepSpeed ZeRO-1. The model was trained on scientific, governmental, news, and Wikipedia data with LoRA adapters to improve factual grounding and reasoning.