Upload 8 files

README.md

@@ -1,3 +1,59 @@
 ---
-license: other
+language: ko
+tags:
+- bert
+- mrc
+datasets:
+- klue
+license: cc-by-sa-4.0
 ---
+
+# bert-base for QA 
+
+**Code:**  See [Ainize Workspace](https://link.ainize.ai/3FjvBVn) 
+
+**klue-bert-base-mrc DEMO**: [Ainize DEMO](https://main-klue-mrc-bert-scy6500.endpoint.ainize.ai/)
+
+**klue-bert-base-mrc API**: [Ainize API](https://ainize.ai/scy6500/KLUE-MRC-BERT?branch=main)
+
+## Overview
+**Language model:** klue/bert-base  
+**Language:** Korean  
+**Downstream-task:** Extractive QA    
+**Training data:** KLUE-MRC  
+**Eval data:** KLUE-MRC  
+ 
+
+
+## Usage
+### In Transformers
+```python
+from transformers import AutoModelForQuestionAnswering, AutoTokenizer
+
+tokenizer = AutoTokenizer.from_pretrained("ainize/klue-bert-base-mrc")
+model = AutoModelForQuestionAnswering.from_pretrained("ainize/klue-bert-base-mrc")
+
+context = "your context"
+question = "your question"
+
+encodings = tokenizer(context, question, max_length=512, truncation=True,
+                      padding="max_length", return_token_type_ids=False)
+encodings = {key: torch.tensor([val]) for key, val in encodings.items()}             
+
+input_ids = encodings["input_ids"]
+attention_mask = encodings["attention_mask"]
+
+pred = model(input_ids, attention_mask=attention_mask)
+
+start_logits, end_logits = pred.start_logits, pred.end_logits
+
+token_start_index, token_end_index = start_logits.argmax(dim=-1), end_logits.argmax(dim=-1)
+
+pred_ids = input_ids[0][token_start_index: token_end_index + 1]
+
+prediction = tokenizer.decode(pred_ids)
+```
+
+## About us
+[Teachable NLP](https://ainize.ai/teachable-nlp) - Train NLP models with your own text without writing any code  
+[Ainize](https://ainize.ai/) - Deploy ML project using free gpu

config.json

@@ -0,0 +1,24 @@
+{
+  "_name_or_path": "./klue_bert/",
+  "architectures": [
+    "BertForQuestionAnswering"
+  ],
+  "attention_probs_dropout_prob": 0.1,
+  "gradient_checkpointing": false,
+  "hidden_act": "gelu",
+  "hidden_dropout_prob": 0.1,
+  "hidden_size": 768,
+  "initializer_range": 0.02,
+  "intermediate_size": 3072,
+  "layer_norm_eps": 1e-12,
+  "max_position_embeddings": 512,
+  "model_type": "bert",
+  "num_attention_heads": 12,
+  "num_hidden_layers": 12,
+  "pad_token_id": 0,
+  "position_embedding_type": "absolute",
+  "transformers_version": "4.7.0",
+  "type_vocab_size": 2,
+  "use_cache": true,
+  "vocab_size": 32000
+}

gitattributes.txt

@@ -0,0 +1,16 @@
+*.bin.* filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tar.gz filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text

pytorch_model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:db34d79c6062826b97b0c7c3a5028d557e7e74d1989924bee049bba144d77a26
+size 440201719

special_tokens_map.json

@@ -0,0 +1 @@
+{"unk_token": "[UNK]", "sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]", "mask_token": "[MASK]"}

tokenizer_config.json

@@ -0,0 +1 @@
+{"do_lower_case": false, "unk_token": "[UNK]", "sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]", "mask_token": "[MASK]", "tokenize_chinese_chars": true, "strip_accents": null, "do_basic_tokenize": true, "never_split": null, "model_max_length": 512, "special_tokens_map_file": "/workspace/.cache/huggingface/transformers/aeaaa3afd086a040be912f92ffe7b5f85008b744624f4517c4216bcc32b51cf0.054ece8d16bd524c8a00f0e8a976c00d5de22a755ffb79e353ee2954d9289e26", "name_or_path": "./klue_bert/"}