rawkintrevo commited on
Commit
cf0934d
1 Parent(s): f2f1242

rawkintrevo/granite-3.0-2b-instruct-pirate-adapter

Browse files
Files changed (3) hide show
  1. README.md +36 -36
  2. adapter_model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -1,57 +1,57 @@
1
  ---
2
  base_model: ibm-granite/granite-3.0-2b-instruct
3
- library_name: peft
4
- license: apache-2.0
5
  tags:
 
6
  - trl
7
  - sft
8
- - generated_from_trainer
9
- model-index:
10
- - name: granite-3.0-2b-instruct-pirate-adapter
11
- results: []
12
  ---
13
 
14
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
- should probably proofread and complete it, then remove this comment. -->
16
-
17
- # granite-3.0-2b-instruct-pirate-adapter
18
-
19
- This model is a fine-tuned version of [ibm-granite/granite-3.0-2b-instruct](https://huggingface.co/ibm-granite/granite-3.0-2b-instruct) on an unknown dataset.
20
 
21
- ## Model description
 
22
 
23
- More information needed
24
 
25
- ## Intended uses & limitations
 
26
 
27
- More information needed
 
 
 
 
28
 
29
- ## Training and evaluation data
30
 
31
- More information needed
32
 
33
- ## Training procedure
34
 
35
- ### Training hyperparameters
36
 
37
- The following hyperparameters were used during training:
38
- - learning_rate: 0.0002
39
- - train_batch_size: 6
40
- - eval_batch_size: 6
41
- - seed: 42
42
- - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
43
- - lr_scheduler_type: linear
44
- - num_epochs: 3
45
- - mixed_precision_training: Native AMP
46
 
47
- ### Training results
 
 
 
 
48
 
 
49
 
50
 
51
- ### Framework versions
52
 
53
- - PEFT 0.13.2
54
- - Transformers 4.46.1
55
- - Pytorch 2.5.0+cu121
56
- - Datasets 3.1.0
57
- - Tokenizers 0.20.1
 
 
 
 
 
 
 
 
1
  ---
2
  base_model: ibm-granite/granite-3.0-2b-instruct
3
+ library_name: transformers
4
+ model_name: granite-3.0-2b-instruct-pirate-adapter
5
  tags:
6
+ - generated_from_trainer
7
  - trl
8
  - sft
9
+ licence: license
 
 
 
10
  ---
11
 
12
+ # Model Card for granite-3.0-2b-instruct-pirate-adapter
 
 
 
 
 
13
 
14
+ This model is a fine-tuned version of [ibm-granite/granite-3.0-2b-instruct](https://huggingface.co/ibm-granite/granite-3.0-2b-instruct).
15
+ It has been trained using [TRL](https://github.com/huggingface/trl).
16
 
17
+ ## Quick start
18
 
19
+ ```python
20
+ from transformers import pipeline
21
 
22
+ question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
23
+ generator = pipeline("text-generation", model="rawkintrevo/granite-3.0-2b-instruct-pirate-adapter", device="cuda")
24
+ output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
25
+ print(output["generated_text"])
26
+ ```
27
 
28
+ ## Training procedure
29
 
 
30
 
 
31
 
32
+ This model was trained with SFT.
33
 
34
+ ### Framework versions
 
 
 
 
 
 
 
 
35
 
36
+ - TRL: 0.12.0
37
+ - Transformers: 4.46.1
38
+ - Pytorch: 2.5.0+cu121
39
+ - Datasets: 3.1.0
40
+ - Tokenizers: 0.20.1
41
 
42
+ ## Citations
43
 
44
 
 
45
 
46
+ Cite TRL as:
47
+
48
+ ```bibtex
49
+ @misc{vonwerra2022trl,
50
+ title = {{TRL: Transformer Reinforcement Learning}},
51
+ author = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallouédec},
52
+ year = 2020,
53
+ journal = {GitHub repository},
54
+ publisher = {GitHub},
55
+ howpublished = {\url{https://github.com/huggingface/trl}}
56
+ }
57
+ ```
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7a9059a1c09cbf9183bd228fa74174b88339869f8f303f051c72494cdff354b2
3
  size 17060712
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4fef0594520e648a1cd7cb3a7bf474d0595d8a3ff450bb74f7b6a784d499605b
3
  size 17060712
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:aaf4bc89a1f144ff9739fefafad2ea8971f713596645de6eb12dc25f3faa3a1c
3
  size 5496
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b92a6478e138b902e59e31de207a898b52d1c845ee025777d933a02cb07e890
3
  size 5496