File size: 1,087 Bytes
4c0d0fd
 
 
 
 
 
1e9a54a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4c0d0fd
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
---
license: apache-2.0
datasets:
- yelp_review_full
language:
- en
model-index:
- name: rttl-ai/bert-base-uncased-reviews
  results:
  - task:
      type: text classification
      name: multi_class_classification
    dataset:
      type: yelp_review_full
      name: yelp_review_full
      config: default
      split: test
    metrics:
    - type: accuracy
      value: 0.7037
      name: Accuracy
---

## Model Details
**Model Description:** This model is a fine-tune checkpoint of [bert-base-uncased](https://huggingface.co/bert-base-uncased), fine-tuned on yelp reviews.

- **Developed by:** rttl-ai
- **Model Type:** Text Classification
- **Language(s):** English
- **License:** Apache-2.0
- **Resources for more information:**
 - The model was pre-trained with task-adaptive pre-training [TAPT](https://arxiv.org/pdf/2004.10964.pdf) with an increased masking rate, no corruption strategy, and using WWM, following [this paper](https://aclanthology.org/2023.eacl-main.217.pdf)
    - pre-trained on yelp reviews 
    - fine-tuned on yelp reviews for multi-class text classification