Hugging Face's logo

aengusl
/
llama2-7b-sft-lora

PEFT
TensorBoard
Safetensors
trl
sft
Generated from Trainer
Model card Files Metrics Community
aengusl commited on
Commit
d13f0e3
•
1 Parent(s): a32010c

Model save

Browse files
Files changed (7) hide show
  1. README.md +1 -1
  2. adapter_config.json +4 -4
  3. runs/Jun07_14-57-52_dbfeb9159435/events.out.tfevents.1717772294.dbfeb9159435.32018.0 +3 -0
  4. step_0/README.md +0 -273
  5. step_0/adapter_config.json +4 -4
  6. step_0/training_args.bin +1 -1
  7. training_args.bin +1 -1
README.md CHANGED
@@ -16,7 +16,7 @@ model-index:
16
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
17
  should probably proofread and complete it, then remove this comment. -->
18
 
19
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/quirky_lats_at_mats/harmbench_adv_training/runs/7trku7jf)
20
  # llama2-7b-sft-lora
21
 
22
  This model is a fine-tuned version of [meta-llama/Llama-2-7b-chat-hf](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf) on the generator dataset.
 
16
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
17
  should probably proofread and complete it, then remove this comment. -->
18
 
19
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/adv-robustness/harmbench_adv_training/runs/xxnrpxv3)
20
  # llama2-7b-sft-lora
21
 
22
  This model is a fine-tuned version of [meta-llama/Llama-2-7b-chat-hf](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf) on the generator dataset.
adapter_config.json CHANGED
@@ -16,12 +16,12 @@
16
  "rank_pattern": {},
17
  "revision": null,
18
  "target_modules": [
19
- "k_proj",
20
  "up_proj",
21
  "o_proj",
22
- "q_proj",
23
- "down_proj",
24
- "v_proj"
25
  ],
26
  "task_type": "CAUSAL_LM"
27
  }
 
16
  "rank_pattern": {},
17
  "revision": null,
18
  "target_modules": [
19
+ "down_proj",
20
  "up_proj",
21
  "o_proj",
22
+ "v_proj",
23
+ "k_proj",
24
+ "q_proj"
25
  ],
26
  "task_type": "CAUSAL_LM"
27
  }
runs/Jun07_14-57-52_dbfeb9159435/events.out.tfevents.1717772294.dbfeb9159435.32018.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa9e22d26a1f0e6efb52509c9123919650bd75bfd3ea69555d3f1eb2c3365aa7
3
+ size 5069
step_0/README.md CHANGED
@@ -294,277 +294,4 @@ Carbon emissions can be estimated using the [Machine Learning Impact calculator]
294
  ### Framework versions
295
 
296
 
297
- - PEFT 0.6.1
298
- ## Training procedure
299
-
300
-
301
- ### Framework versions
302
-
303
-
304
- - PEFT 0.6.1
305
- ## Training procedure
306
-
307
-
308
- ### Framework versions
309
-
310
-
311
- - PEFT 0.6.1
312
- ## Training procedure
313
-
314
-
315
- ### Framework versions
316
-
317
-
318
- - PEFT 0.6.1
319
- ## Training procedure
320
-
321
-
322
- ### Framework versions
323
-
324
-
325
- - PEFT 0.6.1
326
- ## Training procedure
327
-
328
-
329
- ### Framework versions
330
-
331
-
332
- - PEFT 0.6.1
333
- ## Training procedure
334
-
335
-
336
- ### Framework versions
337
-
338
-
339
- - PEFT 0.6.1
340
- ## Training procedure
341
-
342
-
343
- ### Framework versions
344
-
345
-
346
- - PEFT 0.6.1
347
- ## Training procedure
348
-
349
-
350
- ### Framework versions
351
-
352
-
353
- - PEFT 0.6.1
354
- ## Training procedure
355
-
356
-
357
- ### Framework versions
358
-
359
-
360
- - PEFT 0.6.1
361
- ## Training procedure
362
-
363
-
364
- ### Framework versions
365
-
366
-
367
- - PEFT 0.6.1
368
- ## Training procedure
369
-
370
-
371
- ### Framework versions
372
-
373
-
374
- - PEFT 0.6.1
375
- ## Training procedure
376
-
377
-
378
- ### Framework versions
379
-
380
-
381
- - PEFT 0.6.1
382
- ## Training procedure
383
-
384
-
385
- ### Framework versions
386
-
387
-
388
- - PEFT 0.6.1
389
- ## Training procedure
390
-
391
-
392
- ### Framework versions
393
-
394
-
395
- - PEFT 0.6.1
396
- ## Training procedure
397
-
398
-
399
- ### Framework versions
400
-
401
-
402
- - PEFT 0.6.1
403
- ## Training procedure
404
-
405
-
406
- ### Framework versions
407
-
408
-
409
- - PEFT 0.6.1
410
- ## Training procedure
411
-
412
-
413
- ### Framework versions
414
-
415
-
416
- - PEFT 0.6.1
417
- ## Training procedure
418
-
419
-
420
- ### Framework versions
421
-
422
-
423
- - PEFT 0.6.1
424
- ## Training procedure
425
-
426
-
427
- ### Framework versions
428
-
429
-
430
- - PEFT 0.6.1
431
- ## Training procedure
432
-
433
-
434
- ### Framework versions
435
-
436
-
437
- - PEFT 0.6.1
438
- ## Training procedure
439
-
440
-
441
- ### Framework versions
442
-
443
-
444
- - PEFT 0.6.1
445
- ## Training procedure
446
-
447
-
448
- ### Framework versions
449
-
450
-
451
- - PEFT 0.6.1
452
- ## Training procedure
453
-
454
-
455
- ### Framework versions
456
-
457
-
458
- - PEFT 0.6.1
459
- ## Training procedure
460
-
461
-
462
- ### Framework versions
463
-
464
-
465
- - PEFT 0.6.1
466
- ## Training procedure
467
-
468
-
469
- ### Framework versions
470
-
471
-
472
- - PEFT 0.6.1
473
- ## Training procedure
474
-
475
-
476
- ### Framework versions
477
-
478
-
479
- - PEFT 0.6.1
480
- ## Training procedure
481
-
482
-
483
- ### Framework versions
484
-
485
-
486
- - PEFT 0.6.1
487
- ## Training procedure
488
-
489
-
490
- ### Framework versions
491
-
492
-
493
- - PEFT 0.6.1
494
- ## Training procedure
495
-
496
-
497
- ### Framework versions
498
-
499
-
500
- - PEFT 0.6.1
501
- ## Training procedure
502
-
503
-
504
- ### Framework versions
505
-
506
-
507
- - PEFT 0.6.1
508
- ## Training procedure
509
-
510
-
511
- ### Framework versions
512
-
513
-
514
- - PEFT 0.6.1
515
- ## Training procedure
516
-
517
-
518
- ### Framework versions
519
-
520
-
521
- - PEFT 0.6.1
522
- ## Training procedure
523
-
524
-
525
- ### Framework versions
526
-
527
-
528
- - PEFT 0.6.1
529
- ## Training procedure
530
-
531
-
532
- ### Framework versions
533
-
534
-
535
- - PEFT 0.6.1
536
- ## Training procedure
537
-
538
-
539
- ### Framework versions
540
-
541
-
542
- - PEFT 0.6.1
543
- ## Training procedure
544
-
545
-
546
- ### Framework versions
547
-
548
-
549
- - PEFT 0.6.1
550
- ## Training procedure
551
-
552
-
553
- ### Framework versions
554
-
555
-
556
- - PEFT 0.6.1
557
- ## Training procedure
558
-
559
-
560
- ### Framework versions
561
-
562
-
563
- - PEFT 0.6.1
564
- ## Training procedure
565
-
566
-
567
- ### Framework versions
568
-
569
-
570
  - PEFT 0.6.1
 
294
  ### Framework versions
295
 
296
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
297
  - PEFT 0.6.1
step_0/adapter_config.json CHANGED
@@ -16,12 +16,12 @@
16
  "rank_pattern": {},
17
  "revision": null,
18
  "target_modules": [
19
- "k_proj",
20
  "up_proj",
21
  "o_proj",
22
- "q_proj",
23
- "down_proj",
24
- "v_proj"
25
  ],
26
  "task_type": "CAUSAL_LM"
27
  }
 
16
  "rank_pattern": {},
17
  "revision": null,
18
  "target_modules": [
19
+ "down_proj",
20
  "up_proj",
21
  "o_proj",
22
+ "v_proj",
23
+ "k_proj",
24
+ "q_proj"
25
  ],
26
  "task_type": "CAUSAL_LM"
27
  }
step_0/training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:88a9b73696d858c41bcb6b3690500ab1267135ec179266a7e4989865ae7a1d84
3
  size 6200
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5c3f0d69b7289c2152680aaf91e627209062d5efda686d2971e4d7ef29570ab
3
  size 6200
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:88a9b73696d858c41bcb6b3690500ab1267135ec179266a7e4989865ae7a1d84
3
  size 6200
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5c3f0d69b7289c2152680aaf91e627209062d5efda686d2971e4d7ef29570ab
3
  size 6200