Transformers
Back to all models
Model: monologg/distilkobert

Monthly model downloads

monologg/distilkobert monologg/distilkobert
- downloads
last 30 days

pytorch

tf

Contributed by

monologg Jangwon Park
No model yet

How to use this model directly from the 🤗/transformers library:

			
Copy model
tokenizer = AutoTokenizer.from_pretrained("monologg/distilkobert") model = AutoModel.from_pretrained("monologg/distilkobert")

Config

See raw config file
activation: "gelu" ...
attention_dropout: 0.1 ...
dim: 768 ...
dropout: 0.1 ...
▾ finetuning_task: null ...
hidden_dim: 3072 ...
▾ id2label: { "0": "LABEL_0", "1": "LABEL_1" } ...
initializer_range: 0.02 ...
is_decoder: false ...
▾ label2id: { "LABEL_0": 0, "LABEL_1": 1 } ...
max_position_embeddings: 512 ...
n_heads: 12 ...
n_layers: 3 ...
num_labels: 2 ...
output_attentions: false ...
output_hidden_states: true ...
output_past: true ...
▾ pruned_heads: {} ...
qa_dropout: 0.1 ...
seq_classif_dropout: 0.2 ...
sinusoidal_pos_embds: true ...
tie_weights_: true ...
torchscript: false ...
use_bfloat16: false ...
vocab_size: 8002 ...