Transformers
Back to all models
Model: voidism/12to6_distilbert

Monthly model downloads

voidism/12to6_distilbert voidism/12to6_distilbert
- downloads
last 30 days

pytorch

tf

Contributed by

voidism Yung-Sung Chuang
No model yet

How to use this model directly from the 🤗/transformers library:

			
Copy model
tokenizer = AutoTokenizer.from_pretrained("voidism/12to6_distilbert") model = AutoModel.from_pretrained("voidism/12to6_distilbert")

Config

See raw config file
activation: "gelu" ...
attention_dropout: 0.1 ...
dim: 768 ...
dropout: 0.1 ...
▾ finetuning_task: null ...
hidden_dim: 3072 ...
initializer_range: 0.02 ...
is_decoder: false ...
max_position_embeddings: 512 ...
n_heads: 12 ...
n_layers: 6 ...
num_labels: 2 ...
output_attentions: false ...
output_hidden_states: true ...
output_past: true ...
▾ pruned_heads: {} ...
qa_dropout: 0.1 ...
seq_classif_dropout: 0.2 ...
sinusoidal_pos_embds: false ...
tie_weights_: true ...
torchscript: false ...
use_bfloat16: false ...
vocab_size: 30522 ...