|
--- |
|
base_model: H-D-T/Buzz-3b-small-v0.6.3 |
|
tags: |
|
- axolotl |
|
license: apache-2.0 |
|
datasets: |
|
- H-D-T/Buzz |
|
- H-D-T/Buzz-slice-1-10 |
|
- H-D-T/Buzz-slice-2-10 |
|
pipeline_tag: text-generation |
|
--- |
|
|
|
[<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl) |
|
|
|
# Buzz-3b-Small-v0.6.3 |
|
|
|
This model is a intermediate checkpoint of [H-D-T/Buzz-3b-small-v0.6.3](H-D-T/Buzz-3b-small-v0.6.3) trained on |
|
|
|
datasets: |
|
- path: H-D-T/Buzz-slice-1-10 |
|
type: sharegpt |
|
- path: H-D-T/Buzz-slice-2-10 |
|
type: sharegpt |
|
|
|
chat_template: llama3 |
|
|
|
## Model description |
|
|
|
Buzz small 0.6.3 is an intermediate checkpoint 2/10ths of the way through the buzz dataset, its trained using the llama 3 chat template for only a single epoch over approximately 6.2 million examples |
|
|
|
## Intended uses & limitations |
|
the model behaves in a standard 'chat' style, performing the normal tasks an assistant model would typically be expected to perform, often quite well. |
|
|
|
it has the ability to write code, play characters, break down tasks, provide tutorials, step by step walkthroughs, data analysis, and perform mathematical calculations. |
|
|
|
the models outputs may be inaccurate to some degree. |
|
## tutorial |
|
[will update] |
|
|
|
|
|
|
|
|
|
### Framework versions |
|
- unsloth 2.4.0 |
|
- axolotl 4.0.0 |
|
- Transformers 4.40.2 |
|
- Pytorch 2.1.2+cu118 |
|
- Datasets 2.19.1 |
|
- Tokenizers 0.19.1 |
