Model: cnfusion/Mellum-4b-base-mlx-fp16
Author: cnfusion
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, llama, text-generation, code, mlx, mlx-my-repo, dataset:bigcode/the-stack, dataset:bigcode/the-stack-v2, dataset:bigcode/starcoderdata, dataset:bigcode/commitpack, base_model:JetBrains/Mellum-4b-base, base_model:finetune:JetBrains/Mellum-4b-base, license:apache-2.0, model-index, text-generation-inference, endpoints_compatible, region:us
Base models (finetune): id: JetBrains/Mellum-4b-base
Card metadata: license: apache-2.0
datasets: bigcode/the-stack, bigcode/the-stack-v2, bigcode/starcoderdata, bigcode/commitpack
library_name: transformers
tags: code, mlx, mlx-my-repo
base_model: JetBrains/Mellum-4b-base
model-index: name: Mellum-4b-base
results: task: type: text-generation
dataset: name: RepoBench 1.1 (Python)
type: tianyang/repobench_python_v1.1
metrics: type: exact_match
value: 0.2591
name: EM
verified: no, type: exact_match
value: 0.2797
name: EM ≤ 8k
verified: no, type: exact_match
value: 0.282
name: EM
verified: no, type: exact_match
value: 0.2795
name: EM
verified: no, type: exact_match
value: 0.2777
name: EM
verified: no, type: exact_match
value: 0.2453
name: EM
verified: no, type: exact_match
value: 0.211
name: EM
verified: no, task: type: text-generation
dataset: name: RepoBench 1.1 (Java)
type: tianyang/repobench_java_v1.1
metrics: type: exact_match
value: 0.2858
name: EM
verified: no, type: exact_match
value: 0.3108
name: EM ≤ 8k
verified: no, type: exact_match
value: 0.3202
name: EM
verified: no, type: exact_match
value: 0.3212
name: EM
verified: no, type: exact_match
value: 0.291
name: EM
verified: no, type: exact_match
value: 0.2492
name: EM
verified: no, type: exact_match
value: 0.2474
name: EM
verified: no, task: type: text-generation
dataset: name: SAFIM
type: gonglinyuan/safim
metrics: type: pass@1
value: 0.3811
name: pass@1
verified: no, type: pass@1
value: 0.253
name: pass@1
verified: no, type: pass@1
value: 0.3839
name: pass@1
verified: no, type: pass@1
value: 0.5065
name: pass@1
verified: no, task: type: text-generation
dataset: name: HumanEval Infilling (Single-Line)
type: loubnabnl/humaneval_infilling
metrics: type: pass@1
value: 0.6621
name: pass@1
verified: no, type: pass@1
value: 0.3852
name: pass@1
verified: no, type: pass@1
value: 0.2969
name: pass@1
verified: no
Likes: 0 | All-time downloads: 209
Created: 2025-05-09 01:30:38