Bar-Fin commited on
Commit
a0e99ff
1 Parent(s): e81d12e

Upload lora_finetune.ipynb

Browse files
Files changed (1) hide show
  1. lora_finetune.ipynb +5 -29
lora_finetune.ipynb CHANGED
@@ -478,30 +478,6 @@
478
  "## Train! 🧪"
479
  ]
480
  },
481
- {
482
- "cell_type": "markdown",
483
- "id": "733a8ebd-bcc0-4b41-92b4-e95c2e91d363",
484
- "metadata": {
485
- "id": "733a8ebd-bcc0-4b41-92b4-e95c2e91d363",
486
- "pycharm": {
487
- "name": "#%% md\n"
488
- },
489
- "tags": []
490
- },
491
- "source": [
492
- "### `Diffusers` 🧨 Training loop"
493
- ]
494
- },
495
- {
496
- "cell_type": "markdown",
497
- "id": "72b2491e-16fe-4b0c-bb50-41db70766c7b",
498
- "metadata": {
499
- "id": "72b2491e-16fe-4b0c-bb50-41db70766c7b"
500
- },
501
- "source": [
502
- "### Launch training 🚀🚀🚀"
503
- ]
504
- },
505
  {
506
  "cell_type": "markdown",
507
  "id": "6dbd7ec5-d4e2-470f-97f2-011a30d04e63",
@@ -509,11 +485,11 @@
509
  "id": "6dbd7ec5-d4e2-470f-97f2-011a30d04e63"
510
  },
511
  "source": [
512
- "**Set your LoRA rank**\n",
513
- "The rank of your LoRA is linked to its expressiveness.\n",
514
- "The bigger the rank the closer we are to regular dreambooth, and in theory we have more expressive power (and heavier weights).\n",
515
  "\n",
516
- "For a very simple concept that you have a good high quality image set for (e.g. a pet, a generic object), a rank as low as 4 can be enough to get great results. We reccomend going between 8 and 64 depending on your concept and how much of a priortiy it is for you to keep the LoRA small or not. "
517
  ]
518
  },
519
  {
@@ -535,7 +511,7 @@
535
  "id": "78325966",
536
  "metadata": {},
537
  "source": [
538
- "Before you start free some memory:"
539
  ]
540
  },
541
  {
 
478
  "## Train! 🧪"
479
  ]
480
  },
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
481
  {
482
  "cell_type": "markdown",
483
  "id": "6dbd7ec5-d4e2-470f-97f2-011a30d04e63",
 
485
  "id": "6dbd7ec5-d4e2-470f-97f2-011a30d04e63"
486
  },
487
  "source": [
488
+ "**Adjust your LoRA rank**\n",
489
+ "\n",
490
+ "The rank determines how expressive your LoRA will be. Higher ranks bring it closer to standard DreamBooth, offering more expressive capabilities but also increasing the model’s size.\n",
491
  "\n",
492
+ "A recommend rank is between 8 and 64 based on your concept and your priority to balance expressiveness with a smaller LoRA size."
493
  ]
494
  },
495
  {
 
511
  "id": "78325966",
512
  "metadata": {},
513
  "source": [
514
+ "Free some memory if needed"
515
  ]
516
  },
517
  {