---
library_name: peft
base_model: sujitvasanth/TheBloke-openchat-3.5-0106-GPTQ
---

# Model Card for Model ID

<!-- Finetuned version of openchat for extracting information from a database json object. -->


## Model Details

### Model Description

<!-- Finetuned version of openchat for extracting information from a database json object. It is train -->



- **Developed by:** Dr Sujit Vasanth
- **Model type:** QLoRA PEFT
- **Language(s) (NLP):** Json, English
- **License:** [More Information Needed]
- **Finetuned from model [optional]:** TheBloke/openchat-3.5-0106-GPTQ

### Model Sources [optional]

- **Repository:** https://github.com/sujitvasanth/GPTQ-finetune
- **Demo [optional]:** https://github.com/sujitvasanth/GPTQ-finetune/blob/main/GPTQ-finetune.py


## How to Get Started with the Model

model = AutoModelForCausalLM.from_pretrained(model_id,
    quantization_config= GPTQConfig(bits=4, disable_exllama=False),device_map="auto") # is_trainable=True
tokenizer = AutoTokenizer.from_pretrained(model_id)
tokenizer.pad_token = tokenizer.eos_token
model.load_adapter(adapter_id)


## Training Details

### Training Data

<!-- https://huggingface.co/datasets/sujitvasanth/jsonsearch2 -->
https://huggingface.co/datasets/sujitvasanth/jsonsearch2
User: Assistant examples of Json search Query

### Training Procedure 

<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
QLora PEFT training on custom dataset

#### Preprocessing [optional]

[More Information Needed]


#### Training Hyperparameters

- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->

#### Speeds, Sizes, Times [optional]

<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->

[More Information Needed]

## Evaluation

<!-- This section describes the evaluation protocols and provides the results. -->

### Testing Data, Factors & Metrics

#### Testing Data

<!-- This should link to a Dataset Card if possible. -->

[More Information Needed]

#### Factors

<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->

[More Information Needed]

#### Metrics

<!-- These are the evaluation metrics being used, ideally with a description of why. -->

[More Information Needed]

### Results

[More Information Needed]

#### Summary


#### Hardware

[More Information Needed]

#### Software

[More Information Needed]

## Citation [optional]

<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->

**BibTeX:**

[More Information Needed]

**APA:**

[More Information Needed]

## Glossary [optional]

<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->

[More Information Needed]

## More Information [optional]

[More Information Needed]

## Model Card Authors [optional]

[More Information Needed]

## Model Card Contact

[More Information Needed]


### Framework versions

- PEFT 0.8.2