Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

Codeseys
/
composer-replication-framework

Reinforcement Learning
Transformers
English
post-training
distillation
agentic-coding
composer-2.5
cursor
kimi-k2
grpo
dapo
diloco
openenv
trl
verl
research
methodology
Model card Files Files and versions
xet
Community

Instructions to use Codeseys/composer-replication-framework with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • Transformers

    How to use Codeseys/composer-replication-framework with Transformers:

    # Load model directly
    from transformers import AutoModel
    model = AutoModel.from_pretrained("Codeseys/composer-replication-framework", dtype="auto")
  • Notebooks
  • Google Colab
  • Kaggle
composer-replication-framework / composer_replication /trainer
149 kB
Ctrl+K
Ctrl+K
  • 4 contributors
History: 13 commits
Baladithya Balamurugan
Wave 20: Tier-0 fidelity fixes β€” k1-in-reward KL + Composer-2 behavior rewards
41289bf about 2 hours ago
  • tests
    Wave 20: Tier-0 fidelity fixes β€” k1-in-reward KL + Composer-2 behavior rewards about 2 hours ago
  • __init__.py
    517 Bytes
    Wave 1: fix 8 failing tests + unblock Docker E2E + dep/doc debt about 13 hours ago
  • composer_trainer.py
    44.2 kB
    Wave 20: Tier-0 fidelity fixes β€” k1-in-reward KL + Composer-2 behavior rewards about 2 hours ago
  • data_collator.py
    37.1 kB
    feat(wave-a): close ADR-011 (SDPO alignment indices) + ADR-012 (review findings) 11 days ago
  • kl_in_reward.py
    7.92 kB
    Wave 20: Tier-0 fidelity fixes β€” k1-in-reward KL + Composer-2 behavior rewards about 2 hours ago