Update README.md

README.md

@@ -3,36 +3,44 @@ base_model: ai21labs/AI21-Jamba-1.5-Mini
 datasets:
 - bitext/Bitext-combined-banking-wealth_management-mortgage_loans
 license: other
+license_name: jamba-open-model-license
+license_link: https://www.ai21.com/licenses/jamba-open-model-license
+language:
+- en
 tags:
 - alignment-handbook
 - trl
 - sft
+- jamba
 - generated_from_trainer
+- text-generation-inference
+library_name: transformers
 model-index:
 - name: Bitext-Jamba-1.5-Mini-banking-customer-support
   results: []
+pipeline_tag: text-generation
+widget:
+- messages:
+  - role: user
+    content: I want open an account
 ---
 
-<!-- This model card has been generated automatically according to the information the Trainer had access to. You
-should probably proofread and complete it, then remove this comment. -->
+# Bitext-Jamba-1.5-Mini-Banking-Customer-Support
 
-# Bitext-Jamba-1.5-Mini-banking-customer-support
+## Model Description
 
-This model is a fine-tuned version of [ai21labs/AI21-Jamba-1.5-Mini](https://huggingface.co/ai21labs/AI21-Jamba-1.5-Mini) on the bitext/Bitext-combined-banking-wealth_management-mortgage_loans dataset.
-It achieves the following results on the evaluation set:
-- Loss: 0.7288
+This model is version of [ai21labs/AI21-Jamba-1.5-Mini](https://huggingface.co/ai21labs/AI21-Jamba-1.5-Mini) fine-tuned on the [Bitext Banking Customer Support Dataset](bitext/Bitext-combined-banking-wealth_management-mortgage_loans) dataset, which is specifically tailored for the Banking domain. It is optimized to answer questions and assist users with various banking transactions. It has been trained using hybrid synthetic data generated using our NLP/NLG technology and our automated Data Labeling (DAL) tools.
+ 
+The goal of this model is to show that a generic verticalized model makes customization for a final use case much easier. For example, if you are "ACME Bank", you can create your own customized model by using this fine-tuned model and doing an additional fine-tuning using a small amount of your own data. An overview of this approach can be found at: [From General-Purpose LLMs to Verticalized Enterprise Models](https://www.bitext.com/blog/general-purpose-models-verticalized-enterprise-genai/)
 
-## Model description
+## Intended Use
 
-More information needed
+- **Recommended applications**: This model is designed to be used as the first step in Bitext’s two-step approach to LLM fine-tuning for the creation of chatbots, virtual assistants and copilots for the Banking domain, providing customers with fast and accurate answers about their banking needs.
+- **Out-of-scope**: This model is not suited for non-banking related questions and should not be used for providing health, legal, or critical safety advice.
 
-## Intended uses & limitations
+## Training Data
 
-More information needed
-
-## Training and evaluation data
-
-More information needed
+The model was fine-tuned on a dataset comprising various banking-related intents, including transactions like balance checks, money transfers, loan applications, and more, totaling 89 intents each represented by approximately 1000 examples. This comprehensive training helps the model address a broad spectrum of banking-related questions effectively. The dataset follows the same structured approach as our dataset published on Hugging Face as [bitext/Bitext-customer-support-llm-chatbot-training-dataset](https://huggingface.co/datasets/bitext/Bitext-customer-support-llm-chatbot-training-dataset), but with a focus on banking.
 
 ## Training procedure
 
@@ -65,4 +73,21 @@ The following hyperparameters were used during training:
 - Transformers 4.45.0.dev0
 - Pytorch 2.1.0+cu118
 - Datasets 3.1.0
-- Tokenizers 0.19.1
+- Tokenizers 0.19.1
+
+## Limitations and Bias
+
+- The model is trained for banking-specific contexts but may underperform in unrelated areas.
+- Potential biases in the training data could affect the neutrality of the responses; users are encouraged to evaluate responses critically.
+
+## Ethical Considerations
+
+It is important to use this technology thoughtfully, ensuring it does not substitute for human judgment where necessary, especially in sensitive financial situations.
+
+## Acknowledgments
+
+This model was developed and trained by Bitext using proprietary data and technology.
+
+## License
+
+This model, "Bitext-Jamba-1.5-Mini-Banking-Customer-Support", is licensed under the [Jamba Open Model License](https://www.ai21.com/licenses/jamba-open-model-license), a permissive license allowing full research use and commercial use under the license terms. If you need to license the model for your needs, [talk to us](https://www.bitext.com/contact-us/).