README.md

---
datasets:
- Norquinal/claude_multiround_chat_1k
license: cc-by-nc-4.0
---
This is [Jamba-v0.1](https://huggingface.co/ai21labs/Jamba-v0.1) fine-tuned using [QLoRA](https://huggingface.co/Norquinal/Jamba-v0.1-Claude-Chat-LoRA) (4-bit precision) on my [claude_multiround_chat_1k](https://huggingface.co/datasets/Norquinal/claude_multiround_chat_1k) dataset, which is a randomized subset of ~1000 samples from my [claude_multiround_chat_30k](https://huggingface.co/datasets/Norquinal/claude_multiround_chat_30k) dataset.

## Prompt Format
The model was finetuned with a pseudo-Alpaca format:
```
### Instruction
A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions.

### Input
{instruction}

### Response

```

## Example Usage
>### Instruction
>A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions.
>
>### Input
>First, give a brief overview of Chinese cuisine, including its regional diversity. next, describe the importance of the five flavors in Chinese cooking. Then, mention three popular Chinese dishes and their main ingredients. After that, provide a popular Chinese cooking technique and an example of a dish prepared using that technique. Finally, discuss the role of tea in traditional Chinese culture.
>
>### Response
>Chinese cuisine is incredibly diverse due to China's vast size and long history. Different regions have developed distinct styles based on local climates, agriculture, and cultural influences. Northern Chinese food tends to be heartier with more wheat-based dishes like dumplings and noodles while southern Chinese cuisine features more rice-based meals with seafood from nearby rivers and coastlines. 
>
>The Five Flavors - sour, sweet, bitter, salty, and umami (savory) - are foundational principles of balance and harmony in Chinese cooking. Chefs aim to incorporate all five flavors into each meal through a combination of different seasonings, sauces, and techniques. This creates well-rounded dishes that satisfy multiple taste preferences.   
>
>Some popular Chinese dishes include:  
>• Kung Pao Chicken made with chicken breast, peanuts, chili peppers, and Sichuan peppercorns in a savory sauce    
>• Mapo Tofu featuring soft tofu cubes cooked in a spicy sauce with minced pork or beef, fermented black beans, garlic, ginger, and scallions   
>• Hot Pot consisting of thinly sliced meat and vegetables boiled at the table in flavored broth served with dipping sauces    
>
>Steaming is one common Chinese cooking technique used for both meats and vegetables. Steamed Fish with Ginger and Scallions exemplifies this method where fish fillets are steamed atop chopped ginger slices and green onions until fully cooked yet still tender.     
>
>Tea plays an integral part in Chinese culture dating back thousands of years. It is consumed daily as a beverage but also valued for medicinal properties and ceremonial purposes associated with hospitality, etiquette, and spirituality. Tea houses remain popular social gathering places throughout modern China.
>
>Hope this provides a good summary covering key aspects of Chinese cuisine you requested! I tried to organize my response logically starting broadly then narrowing down specific examples.
>

### Training Hyperparameters
* **LoRA Rank:** 64
* **LoRA Alpha:** 16
* **LoRA Dropout:** 0.1
* **Epochs:** 4
* **Learning Rate:** 7.5e-5
* **LR Scheduler Type:** constant_with_warmup