---
base_model: NickyNicky/gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2
datasets:
- hiyouga/glaive-function-calling-v2-sharegpt
- NickyNicky/function-calling_chatml_gemma_v1
inference: false
language:
- en
library_name: transformers
license: apache-2.0
model:
- google/gemma-1.1-2b-it
model_creator: NickyNicky
model_name: gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2
pipeline_tag: text-generation
quantized_by: afrideva
tags:
- gguf
- ggml
- quantized
- q2_k
- q3_k_m
- q4_k_m
- q5_k_m
- q6_k
- q8_0
widget:
- text: '<bos><start_of_turn>system

    You are a helpful AI assistant.<end_of_turn>

    <start_of_turn>user

    {question}<end_of_turn>

    <start_of_turn>model

    '
---
# NickyNicky/gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2-GGUF

Quantized GGUF model files for [gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2](https://huggingface.co/NickyNicky/gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2) from [NickyNicky](https://huggingface.co/NickyNicky)


| Name | Quant method | Size |
| ---- | ---- | ---- |
| [gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.fp16.gguf](https://huggingface.co/afrideva/gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2-GGUF/resolve/main/gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.fp16.gguf) | fp16 | 5.02 GB  |
| [gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q2_k.gguf](https://huggingface.co/afrideva/gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2-GGUF/resolve/main/gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q2_k.gguf) | q2_k | 1.16 GB  |
| [gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q3_k_m.gguf](https://huggingface.co/afrideva/gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2-GGUF/resolve/main/gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q3_k_m.gguf) | q3_k_m | 1.38 GB  |
| [gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q4_k_m.gguf](https://huggingface.co/afrideva/gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2-GGUF/resolve/main/gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q4_k_m.gguf) | q4_k_m | 1.63 GB  |
| [gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q5_k_m.gguf](https://huggingface.co/afrideva/gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2-GGUF/resolve/main/gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q5_k_m.gguf) | q5_k_m | 1.84 GB  |
| [gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q6_k.gguf](https://huggingface.co/afrideva/gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2-GGUF/resolve/main/gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q6_k.gguf) | q6_k | 2.06 GB  |
| [gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q8_0.gguf](https://huggingface.co/afrideva/gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2-GGUF/resolve/main/gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q8_0.gguf) | q8_0 | 2.67 GB  |



## Original Model Card:
<p align="center">
  <img src="https://cdn-uploads.huggingface.co/production/uploads/641b435ba5f876fe30c5ae0a/Ds-Nf-6VvLdpUx_l0Yiu_.png" alt="" style="width: 95%; max-height: 750px;">
</p>



## Metrics.

<p align="center">
  <img src="https://cdn-uploads.huggingface.co/production/uploads/641b435ba5f876fe30c5ae0a/clMqtJvaKZQ3y4sCdxHNC.png" alt="" style="width: 95%; max-height: 750px;">
</p>

<p align="center">
  <img src="https://cdn-uploads.huggingface.co/production/uploads/641b435ba5f876fe30c5ae0a/jd63fRtz2fCs9AxYKTsaP.png" alt="" style="width: 95%; max-height: 750px;">
</p>


```
interrupted execution no TrainOutput
```

## Take dataset.
```
hiyouga/glaive-function-calling-v2-sharegpt
```

## Dataset format gemma fine tune.
```
NickyNicky/function-calling_chatml_gemma_v1
```

## colab examples and Gradio.
```
https://colab.research.google.com/drive/1an2D2C3VNs32UV9kWlXEPJjio0uJN6nW?usp=sharing
```