---
language: en
tags:
- Transformers
license: apache-2.0
datasets:
- SMHD
- Schizophrenia Reddit
---

# SchizophreniaRoberta model

is a model initialized with [roberta-large](https://huggingface.co/roberta-large) and trained with Schizophrenia Reddit, a subset of [Self-Reported Mental Health Diagnoses (SMHD) dataset](https://arxiv.org/pdf/1806.05258.pdf) which consists of Reddit posts by patients with schizophrenia only or schizophrenia with other mental disorders and matched control. We follow the standard pretraining protocols of RoBERTa with [Huggingface’s Transformers library](https://github.com/huggingface/transformers).    

## Usage Load the model via [Huggingface’s Transformers library](https://github.com/huggingface/transformers):   

from transformers import AutoTokenizer,    
AutoModel tokenizer = AutoTokenizer.from_pretrained("Amalq/schizophrenia-roberta-large")    
model = AutoModel.from_pretrained("Amalq/schizophrenia-roberta-large")   


Perplexity of this model is: 4.43