---
library_name: transformers
language:
- tr
---

# Model Card for Model ID

<!-- Provide a quick summary of what the model is/does. -->


### Model Description
This model is a fine-tuned version of Mistral 7B using the LoRA (Low-Rank Adaptation) method. It has been developed with the Turkish finance dataset "umarigan/turkiye_finance_qa" to better understand Turkish texts in the financial domain and to perform well in related tasks.

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

- **Developed by:** [linkedin @saribasmetehan]
- **Shared by [optional]:** [linkedin @saribasmetehan]
- **Model type:** [Mistral 7B fine-tuned with LoRA]
- **Language(s) (NLP):** [Turkish]
- **Finetuned from model [optional]:** [mistralai/Mistral-7B-v0.1]
- **Fine-tuning Steps and Model Usage:**[github @saribasmetehan] 

## Bias, Risks, and Limitations

**Bias**

- **Language Bias:** Since the model is trained only on Turkish data, it may not perform well in other languages.
- **Domain Bias:** As the model is trained on Turkish finance data, its performance may be lower in other domains (e.g., healthcare, technology).
- **Data Bias:** The data set used is collected from specific sources within a certain time frame, so biases in the data may be reflected in the model's outputs.

**Risks**

- **Misinformation:** The model may generate incorrect information. It is important to verify the accuracy of the outputs.
- **Over-reliance:** Users should not overly rely on the model's outputs and should seek human review and approval when making critical decisions.
- **Ethical Concerns:** The model may raise ethical and privacy concerns when working with sensitive financial information.
**Limitations**

- **Limited Knowledge Base:** The model's knowledge base is limited to the training data and may not include the most recent information or events.
- **Performance in Complex Scenarios:** The model may not perform adequately in very complex financial scenarios or those requiring in-depth analysis.
- **Resource Intensive:** Using large models can require significant computational power and resources.



## How to Get Started with the Model

To get started with this model on Google Colab, you can use the following link:

[Open in Colab](https://colab.research.google.com/drive/1L06josc20C5PrxLctchnzs5DgSeH3NHo?usp=sharing)

## Training Details
<ul>
  <li>Learning_rate=2e-5</li>
  <li>Per device train batch size=8 </li>
  <li>Trainable params: 21260288</li>
  <li>All params: 3773331456</li>
  <li>Ratio%: 0.5634354746703705</li>
</ul>

### Training Data

umarigan/turkiye_finance_qa




## Model Card Contact

metehansaribas001@gmail.com