noriyukipy commited on
Commit
478f488
1 Parent(s): 8629ef0

Modify architecture in config.json from BertForPreTraining to BertForMaskedLM to allow inference API to estimate a pipeline type

Browse files
Files changed (3) hide show
  1. CHANGELOG.md +5 -0
  2. README.md +1 -1
  3. config.json +1 -1
CHANGELOG.md CHANGED
@@ -5,3 +5,8 @@
5
  ### Added
6
 
7
  - models and model card
 
 
 
 
 
 
5
  ### Added
6
 
7
  - models and model card
8
+
9
+ ### Modified
10
+
11
+ - architecture in config.json from BertForPreTraining to BertForMaskedLM to allow inference API to estimate a pipeline type
12
+
README.md CHANGED
@@ -58,7 +58,7 @@ Training code is available in [a GitHub repository](https://github.com/colorfuls
58
  First, install dependecies.
59
 
60
  ```sh
61
- $ pip install torch==1.8.0 transformers==4.8.2 sentencepiece==0.1.95 tensorflow==2.5.0
62
  ```
63
 
64
  Then use `transformers.pipeline` to try mask fill task.
 
58
  First, install dependecies.
59
 
60
  ```sh
61
+ $ pip install torch==1.8.0 transformers==4.8.2 sentencepiece==0.1.95
62
  ```
63
 
64
  Then use `transformers.pipeline` to try mask fill task.
config.json CHANGED
@@ -1,7 +1,7 @@
1
  {
2
  "_name_or_path": "release/bert-base-ja",
3
  "architectures": [
4
- "BertForPreTraining"
5
  ],
6
  "attention_probs_dropout_prob": 0.1,
7
  "bos_token_id": 2,
 
1
  {
2
  "_name_or_path": "release/bert-base-ja",
3
  "architectures": [
4
+ "BertForMaskedLM"
5
  ],
6
  "attention_probs_dropout_prob": 0.1,
7
  "bos_token_id": 2,