Spaces:
Running
Running
Upload lora_finetune.ipynb
Browse files- lora_finetune.ipynb +5 -29
lora_finetune.ipynb
CHANGED
@@ -478,30 +478,6 @@
|
|
478 |
"## Train! 🧪"
|
479 |
]
|
480 |
},
|
481 |
-
{
|
482 |
-
"cell_type": "markdown",
|
483 |
-
"id": "733a8ebd-bcc0-4b41-92b4-e95c2e91d363",
|
484 |
-
"metadata": {
|
485 |
-
"id": "733a8ebd-bcc0-4b41-92b4-e95c2e91d363",
|
486 |
-
"pycharm": {
|
487 |
-
"name": "#%% md\n"
|
488 |
-
},
|
489 |
-
"tags": []
|
490 |
-
},
|
491 |
-
"source": [
|
492 |
-
"### `Diffusers` 🧨 Training loop"
|
493 |
-
]
|
494 |
-
},
|
495 |
-
{
|
496 |
-
"cell_type": "markdown",
|
497 |
-
"id": "72b2491e-16fe-4b0c-bb50-41db70766c7b",
|
498 |
-
"metadata": {
|
499 |
-
"id": "72b2491e-16fe-4b0c-bb50-41db70766c7b"
|
500 |
-
},
|
501 |
-
"source": [
|
502 |
-
"### Launch training 🚀🚀🚀"
|
503 |
-
]
|
504 |
-
},
|
505 |
{
|
506 |
"cell_type": "markdown",
|
507 |
"id": "6dbd7ec5-d4e2-470f-97f2-011a30d04e63",
|
@@ -509,11 +485,11 @@
|
|
509 |
"id": "6dbd7ec5-d4e2-470f-97f2-011a30d04e63"
|
510 |
},
|
511 |
"source": [
|
512 |
-
"**
|
513 |
-
"
|
514 |
-
"The
|
515 |
"\n",
|
516 |
-
"
|
517 |
]
|
518 |
},
|
519 |
{
|
@@ -535,7 +511,7 @@
|
|
535 |
"id": "78325966",
|
536 |
"metadata": {},
|
537 |
"source": [
|
538 |
-
"
|
539 |
]
|
540 |
},
|
541 |
{
|
|
|
478 |
"## Train! 🧪"
|
479 |
]
|
480 |
},
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
481 |
{
|
482 |
"cell_type": "markdown",
|
483 |
"id": "6dbd7ec5-d4e2-470f-97f2-011a30d04e63",
|
|
|
485 |
"id": "6dbd7ec5-d4e2-470f-97f2-011a30d04e63"
|
486 |
},
|
487 |
"source": [
|
488 |
+
"**Adjust your LoRA rank**\n",
|
489 |
+
"\n",
|
490 |
+
"The rank determines how expressive your LoRA will be. Higher ranks bring it closer to standard DreamBooth, offering more expressive capabilities but also increasing the model’s size.\n",
|
491 |
"\n",
|
492 |
+
"A recommend rank is between 8 and 64 based on your concept and your priority to balance expressiveness with a smaller LoRA size."
|
493 |
]
|
494 |
},
|
495 |
{
|
|
|
511 |
"id": "78325966",
|
512 |
"metadata": {},
|
513 |
"source": [
|
514 |
+
"Free some memory if needed"
|
515 |
]
|
516 |
},
|
517 |
{
|