shahidul034 commited on
Commit
3f5a9a9
1 Parent(s): e2659be

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -0
README.md CHANGED
@@ -4,6 +4,9 @@ pipeline_tag: text-generation
4
  ---
5
  KUETLLM is a [zephyr7b-beta](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta) finetune, using a dataset with prompts and answers about Khulna University of Engineering and Technology.
6
  It was loaded in 8 bit quantization using [bitsandbytes](https://github.com/TimDettmers/bitsandbytes). [LORA](https://huggingface.co/docs/diffusers/main/en/training/lora) was used to finetune an adapter, which was leter merged with the base unquantized model.
 
 
 
7
 
8
  Below is the training configuarations for the finetuning process:
9
  ```
 
4
  ---
5
  KUETLLM is a [zephyr7b-beta](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta) finetune, using a dataset with prompts and answers about Khulna University of Engineering and Technology.
6
  It was loaded in 8 bit quantization using [bitsandbytes](https://github.com/TimDettmers/bitsandbytes). [LORA](https://huggingface.co/docs/diffusers/main/en/training/lora) was used to finetune an adapter, which was leter merged with the base unquantized model.
7
+ System architecture:
8
+ datasets:
9
+ - University information(collected from website)
10
 
11
  Below is the training configuarations for the finetuning process:
12
  ```