Hugging Face's logo

aengusl
/
llama2-7b-sft-lora

PEFT
TensorBoard
Safetensors
trl
sft
Generated from Trainer
Model card Files Metrics Community
aengusl commited on
Commit
0847e44
•
1 Parent(s): 9a683fb

Model save

Browse files
Files changed (7) hide show
  1. README.md +1 -1
  2. adapter_config.json +3 -3
  3. runs/Jun06_17-30-17_dbfeb9159435/events.out.tfevents.1717695322.dbfeb9159435.5805.0 +3 -0
  4. step_0/README.md +0 -336
  5. step_0/adapter_config.json +3 -3
  6. step_0/training_args.bin +1 -1
  7. training_args.bin +1 -1
README.md CHANGED
@@ -16,7 +16,7 @@ model-index:
16
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
17
  should probably proofread and complete it, then remove this comment. -->
18
 
19
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/quirky_lats_at_mats/harmbench_adv_training/runs/34e0tvo8)
20
  # llama2-7b-sft-lora
21
 
22
  This model is a fine-tuned version of [meta-llama/Llama-2-7b-chat-hf](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf) on the generator dataset.
 
16
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
17
  should probably proofread and complete it, then remove this comment. -->
18
 
19
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/adv-robustness/harmbench_adv_training/runs/t2u744d7)
20
  # llama2-7b-sft-lora
21
 
22
  This model is a fine-tuned version of [meta-llama/Llama-2-7b-chat-hf](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf) on the generator dataset.
adapter_config.json CHANGED
@@ -16,12 +16,12 @@
16
  "rank_pattern": {},
17
  "revision": null,
18
  "target_modules": [
19
- "q_proj",
20
  "k_proj",
21
- "o_proj",
22
  "up_proj",
23
  "down_proj",
24
- "v_proj"
 
25
  ],
26
  "task_type": "CAUSAL_LM"
27
  }
 
16
  "rank_pattern": {},
17
  "revision": null,
18
  "target_modules": [
 
19
  "k_proj",
20
+ "v_proj",
21
  "up_proj",
22
  "down_proj",
23
+ "o_proj",
24
+ "q_proj"
25
  ],
26
  "task_type": "CAUSAL_LM"
27
  }
runs/Jun06_17-30-17_dbfeb9159435/events.out.tfevents.1717695322.dbfeb9159435.5805.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3cf34ed62a50b4e0422469542a8d04ec222a313920cb5e0028c09085892a24e6
3
+ size 5069
step_0/README.md CHANGED
@@ -203,340 +203,4 @@ Carbon emissions can be estimated using the [Machine Learning Impact calculator]
203
  ### Framework versions
204
 
205
 
206
- - PEFT 0.6.1
207
- ## Training procedure
208
-
209
-
210
- ### Framework versions
211
-
212
-
213
- - PEFT 0.6.1
214
- ## Training procedure
215
-
216
-
217
- ### Framework versions
218
-
219
-
220
- - PEFT 0.6.1
221
- ## Training procedure
222
-
223
-
224
- ### Framework versions
225
-
226
-
227
- - PEFT 0.6.1
228
- ## Training procedure
229
-
230
-
231
- ### Framework versions
232
-
233
-
234
- - PEFT 0.6.1
235
- ## Training procedure
236
-
237
-
238
- ### Framework versions
239
-
240
-
241
- - PEFT 0.6.1
242
- ## Training procedure
243
-
244
-
245
- ### Framework versions
246
-
247
-
248
- - PEFT 0.6.1
249
- ## Training procedure
250
-
251
-
252
- ### Framework versions
253
-
254
-
255
- - PEFT 0.6.1
256
- ## Training procedure
257
-
258
-
259
- ### Framework versions
260
-
261
-
262
- - PEFT 0.6.1
263
- ## Training procedure
264
-
265
-
266
- ### Framework versions
267
-
268
-
269
- - PEFT 0.6.1
270
- ## Training procedure
271
-
272
-
273
- ### Framework versions
274
-
275
-
276
- - PEFT 0.6.1
277
- ## Training procedure
278
-
279
-
280
- ### Framework versions
281
-
282
-
283
- - PEFT 0.6.1
284
- ## Training procedure
285
-
286
-
287
- ### Framework versions
288
-
289
-
290
- - PEFT 0.6.1
291
- ## Training procedure
292
-
293
-
294
- ### Framework versions
295
-
296
-
297
- - PEFT 0.6.1
298
- ## Training procedure
299
-
300
-
301
- ### Framework versions
302
-
303
-
304
- - PEFT 0.6.1
305
- ## Training procedure
306
-
307
-
308
- ### Framework versions
309
-
310
-
311
- - PEFT 0.6.1
312
- ## Training procedure
313
-
314
-
315
- ### Framework versions
316
-
317
-
318
- - PEFT 0.6.1
319
- ## Training procedure
320
-
321
-
322
- ### Framework versions
323
-
324
-
325
- - PEFT 0.6.1
326
- ## Training procedure
327
-
328
-
329
- ### Framework versions
330
-
331
-
332
- - PEFT 0.6.1
333
- ## Training procedure
334
-
335
-
336
- ### Framework versions
337
-
338
-
339
- - PEFT 0.6.1
340
- ## Training procedure
341
-
342
-
343
- ### Framework versions
344
-
345
-
346
- - PEFT 0.6.1
347
- ## Training procedure
348
-
349
-
350
- ### Framework versions
351
-
352
-
353
- - PEFT 0.6.1
354
- ## Training procedure
355
-
356
-
357
- ### Framework versions
358
-
359
-
360
- - PEFT 0.6.1
361
- ## Training procedure
362
-
363
-
364
- ### Framework versions
365
-
366
-
367
- - PEFT 0.6.1
368
- ## Training procedure
369
-
370
-
371
- ### Framework versions
372
-
373
-
374
- - PEFT 0.6.1
375
- ## Training procedure
376
-
377
-
378
- ### Framework versions
379
-
380
-
381
- - PEFT 0.6.1
382
- ## Training procedure
383
-
384
-
385
- ### Framework versions
386
-
387
-
388
- - PEFT 0.6.1
389
- ## Training procedure
390
-
391
-
392
- ### Framework versions
393
-
394
-
395
- - PEFT 0.6.1
396
- ## Training procedure
397
-
398
-
399
- ### Framework versions
400
-
401
-
402
- - PEFT 0.6.1
403
- ## Training procedure
404
-
405
-
406
- ### Framework versions
407
-
408
-
409
- - PEFT 0.6.1
410
- ## Training procedure
411
-
412
-
413
- ### Framework versions
414
-
415
-
416
- - PEFT 0.6.1
417
- ## Training procedure
418
-
419
-
420
- ### Framework versions
421
-
422
-
423
- - PEFT 0.6.1
424
- ## Training procedure
425
-
426
-
427
- ### Framework versions
428
-
429
-
430
- - PEFT 0.6.1
431
- ## Training procedure
432
-
433
-
434
- ### Framework versions
435
-
436
-
437
- - PEFT 0.6.1
438
- ## Training procedure
439
-
440
-
441
- ### Framework versions
442
-
443
-
444
- - PEFT 0.6.1
445
- ## Training procedure
446
-
447
-
448
- ### Framework versions
449
-
450
-
451
- - PEFT 0.6.1
452
- ## Training procedure
453
-
454
-
455
- ### Framework versions
456
-
457
-
458
- - PEFT 0.6.1
459
- ## Training procedure
460
-
461
-
462
- ### Framework versions
463
-
464
-
465
- - PEFT 0.6.1
466
- ## Training procedure
467
-
468
-
469
- ### Framework versions
470
-
471
-
472
- - PEFT 0.6.1
473
- ## Training procedure
474
-
475
-
476
- ### Framework versions
477
-
478
-
479
- - PEFT 0.6.1
480
- ## Training procedure
481
-
482
-
483
- ### Framework versions
484
-
485
-
486
- - PEFT 0.6.1
487
- ## Training procedure
488
-
489
-
490
- ### Framework versions
491
-
492
-
493
- - PEFT 0.6.1
494
- ## Training procedure
495
-
496
-
497
- ### Framework versions
498
-
499
-
500
- - PEFT 0.6.1
501
- ## Training procedure
502
-
503
-
504
- ### Framework versions
505
-
506
-
507
- - PEFT 0.6.1
508
- ## Training procedure
509
-
510
-
511
- ### Framework versions
512
-
513
-
514
- - PEFT 0.6.1
515
- ## Training procedure
516
-
517
-
518
- ### Framework versions
519
-
520
-
521
- - PEFT 0.6.1
522
- ## Training procedure
523
-
524
-
525
- ### Framework versions
526
-
527
-
528
- - PEFT 0.6.1
529
- ## Training procedure
530
-
531
-
532
- ### Framework versions
533
-
534
-
535
- - PEFT 0.6.1
536
- ## Training procedure
537
-
538
-
539
- ### Framework versions
540
-
541
-
542
  - PEFT 0.6.1
 
203
  ### Framework versions
204
 
205
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
206
  - PEFT 0.6.1
step_0/adapter_config.json CHANGED
@@ -16,12 +16,12 @@
16
  "rank_pattern": {},
17
  "revision": null,
18
  "target_modules": [
19
- "q_proj",
20
  "k_proj",
21
- "o_proj",
22
  "up_proj",
23
  "down_proj",
24
- "v_proj"
 
25
  ],
26
  "task_type": "CAUSAL_LM"
27
  }
 
16
  "rank_pattern": {},
17
  "revision": null,
18
  "target_modules": [
 
19
  "k_proj",
20
+ "v_proj",
21
  "up_proj",
22
  "down_proj",
23
+ "o_proj",
24
+ "q_proj"
25
  ],
26
  "task_type": "CAUSAL_LM"
27
  }
step_0/training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1e2c9a2b1cb4e2dfa14d8212da2fd383113a1be178af34978438aae3437752da
3
  size 6200
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:34e3f33b4eef029effdfbe8a67e590b077e247335f4994b61f29bfd41d85062f
3
  size 6200
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1e2c9a2b1cb4e2dfa14d8212da2fd383113a1be178af34978438aae3437752da
3
  size 6200
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:34e3f33b4eef029effdfbe8a67e590b077e247335f4994b61f29bfd41d85062f
3
  size 6200