File size: 1,051 Bytes
e41c2b0 6a9de20 e41c2b0 1736de2 e41c2b0 1736de2 e41c2b0 1736de2 e41c2b0 1736de2 e41c2b0 6a9de20 e41c2b0 6a9de20 e41c2b0 6a9de20 e41c2b0 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 |
---
library_name: transformers
tags: []
---
# Model Card for Model ID
<!-- Provide a quick summary of what the model is/does. -->
## Model Details
### Model Description
<!-- Provide a longer summary of what this model is. -->
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
- **Developed by:** arcee.ai
- **Finetuned from model:** mistralai/Mistral-7B-Instruct-v0.2
## Uses
<!-- This has continually trained with the SEC data -->
### Direct Use
<!-- Since we used the instruct version of the Mistral we can use this directly. -->
## Training Details
### Training Data
<!-- We used https://huggingface.co/datasets/arcee-ai/sec-data-full which consists of 2.5B tokens -->
### Training Procedure
<!-- We used the CPT method in the hugging face alignment book -->
#### Preprocessing
Tokenized and packed into 4096 chunks with the SFT trainer
#### Training Hyperparameters
- **Training regime:** Used SFT trainer <!-- bf16 mixed precision -->
|