Model: Arko007/zenyx-vanta-bert
Author: Arko007
Library: jax
Tags: jax, safetensors, bert, vanta, mlm, rope, swiglu, gqa, en, dataset:HuggingFaceFW/fineweb-edu, dataset:HuggingFaceFW/fineweb, dataset:bigcode/starcoderdata, dataset:open-web-math/open-web-math, license:apache-2.0, region:us
Card metadata: language: en
license: apache-2.0
library_name: jax
tags: vanta, bert, mlm, rope, swiglu, gqa
datasets: HuggingFaceFW/fineweb-edu, HuggingFaceFW/fineweb, bigcode/starcoderdata, open-web-math/open-web-math
metrics: loss
Likes: 0 | All-time downloads: 30
Created: 2025-12-21 13:53:06