oenpu
/

gemma-3-1b-it-6layers

Model card Files Files and versions

gemma-3-1b-it-6layers

A 6-layer extraction from google/gemma-3-1b-it.

Kept layers

new idx	original idx	attention
0	0	sliding_attention
1	1	sliding_attention
2	2	sliding_attention
3	3	sliding_attention
4	4	sliding_attention
5	5	full_attention

Downloads last month: -

Safetensors

Model size

0.5B params

Tensor type

BF16

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for oenpu/gemma-3-1b-it-6layers

Base model

google/gemma-3-1b-pt

Finetuned

google/gemma-3-1b-it

Finetuned

(571)

this model