ShieldX/manovyadh-1.1B-v1

Uploaded model

• Developed by: ShieldX
• License: apache-2.0
• Finetuned from model : unsloth/tinyllama

ShieldX/manovyadh-1.1B-v1

Introducing ManoVyadh, A finetuned version of TinyLlama 1.1B Chat on Mental Health Counselling Dataset.

Model Details

Model Description

ManoVyadh is a LLM for mental health counselling.

Uses

Direct Use

• base model for further finetuning
• for fun

Downstream Use

• can be deployed with api
• used to create webapp or app to show demo

Out-of-Scope Use

• cannot be used for production purpose
• not to be applied in real life health purpose
• cannot be used to generate text for research or academic purposes

Bias, Risks, and Limitations

Significant research has explored bias and fairness issues with language models (see, e.g., Sheng et al. (2021) and Bender et al. (2021)). Predictions generated by the model may include disturbing and harmful stereotypes across protected classes; identity characteristics; and sensitive, social, and occupational groups.

Training Details

Model Examination

We will be further finetuning this model on large dataset to see how it performs

Environmental Impact

Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

• Hardware Type: 1 X Tesla T4
• Hours used: 0.30
• Cloud Provider: Google Colab
• Compute Region: India

Technical Specifications

Model Architecture and Objective

Finetuned on Tiny-Llama 1.1B Chat model

Hardware

1 X Tesla T4

Citation

BibTeX:

@misc{ShieldX/manovyadh-1.1B-v1,
      url={[https://huggingface.co/ShieldX/manovyadh-1.1B-v1](https://huggingface.co/ShieldX/manovyadh-1.1B-v1)},
      title={ManoVyadh},
      author={Rohan Shaw},
      year={2024}, month={Jan}
}

Model Card Authors

ShieldX a.k.a Rohan Shaw

Model Card Contact

email : rohanshaw.dev@gmail.com

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.