nitrosocke

/

redshift-diffusion

like 608

More info on what's not working, error messages or settings and results will help me make suggestions.
In theory there should be no issues training on this model.

Sorry, i will try again and share the log sometime soon. I think it's like a HTTPS type error or it thinks there's something missing. I can use all SD models but have trouble with the finetunes. I even tried putting it on my drive to no avail.

I don't know, I've examined the logs and it's just a hot mess, classic missing link situation. A difference in the VAE maybe, probably an issue better suited for Shivam on github since he runs the colab. I've tried every possible link to your directory and even importing the .ckpt and .json, but just isn't working. Wondering if all or some of your training data can be made public, if you still have it and/or have the time? Probably would be easier to just make my own model with it. Would not reproduce.

Regardless, thanks for redshift, it works great even without a finetune.

All I put was "nitrosocke/redshift-diffusion" in the settings and run cell on this colab: https://colab.research.google.com/github/ShivamShrirao/diffusers/blob/main/examples/dreambooth/DreamBooth_Stable_Diffusion.ipynb
works for all the SD models.

Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/huggingface_hub/utils/_errors.py", line 239, in hf_raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://huggingface.co/nitrosocke/redshift-diffusion/resolve/fp16/tokenizer/vocab.json

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/transformers/utils/hub.py", line 409, in cached_file
resolved_file = hf_hub_download(
File "/usr/local/lib/python3.8/dist-packages/huggingface_hub/utils/_validators.py", line 124, in _inner_fn
return fn(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/huggingface_hub/file_download.py", line 1067, in hf_hub_download
metadata = get_hf_file_metadata(
File "/usr/local/lib/python3.8/dist-packages/huggingface_hub/utils/_validators.py", line 124, in _inner_fn
return fn(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/huggingface_hub/file_download.py", line 1376, in get_hf_file_metadata
hf_raise_for_status(r)
File "/usr/local/lib/python3.8/dist-packages/huggingface_hub/utils/_errors.py", line 249, in hf_raise_for_status
raise RevisionNotFoundError(message, response) from e
huggingface_hub.utils._errors.RevisionNotFoundError: 404 Client Error. (Request ID: Root=1-6392c793-39e856794f0ac9550de42b79)

Revision Not Found for url: https://huggingface.co/nitrosocke/redshift-diffusion/resolve/fp16/tokenizer/vocab.json.
Invalid rev id: fp16

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "train_dreambooth.py", line 822, in
main(args)
File "train_dreambooth.py", line 493, in main
tokenizer = CLIPTokenizer.from_pretrained(
File "/usr/local/lib/python3.8/dist-packages/transformers/tokenization_utils_base.py", line 1760, in from_pretrained
resolved_vocab_files[file_id] = cached_file(
File "/usr/local/lib/python3.8/dist-packages/transformers/utils/hub.py", line 431, in cached_file
raise EnvironmentError(
OSError: fp16 is not a valid git identifier (branch name, tag name or commit id) that exists for this model name. Check the model page at 'https://huggingface.co/nitrosocke/redshift-diffusion' for available revisions.
Traceback (most recent call last):
File "/usr/local/bin/accelerate", line 8, in
sys.exit(main())
File "/usr/local/lib/python3.8/dist-packages/accelerate/commands/accelerate_cli.py", line 43, in main
args.func(args)
File "/usr/local/lib/python3.8/dist-packages/accelerate/commands/launch.py", line 837, in launch_command
simple_launcher(args)
File "/usr/local/lib/python3.8/dist-packages/accelerate/commands/launch.py", line 354, in simple_launcher
raise subprocess.CalledProcessError(returncode=process.returncode, cmd=cmd)
subprocess.CalledProcessError: Command '['/usr/bin/python3', 'train_dreambooth.py', '--pretrained_model_name_or_path=nitrosocke/redshift-diffusion', '--pretrained_vae_name_or_path=stabilityai/sd-vae-ft-mse', '--output_dir=/content/drive/MyDrive/stable_diffusion_weights/rss', '--revision=fp16', '--with_prior_preservation', '--prior_loss_weight=1.0', '--seed=1337', '--resolution=512', '--train_batch_size=1', '--train_text_encoder', '--mixed_precision=fp16', '--use_8bit_adam', '--gradient_accumulation_steps=1', '--learning_rate=1e-6', '--lr_scheduler=constant', '--lr_warmup_steps=0', '--num_class_images=35', '--sample_batch_size=4', '--max_train_steps=7000', '--save_interval=3500', '--save_sample_prompt=photo of zwx dog', '--concepts_list=concepts_list.json']' returned non-zero exit status 1.

This is your issue:
Revision Not Found for url: https://huggingface.co/nitrosocke/redshift-diffusion/resolve/fp16/tokenizer/vocab.json.
Invalid rev id: fp16

There is no "fp16" branch on my release. By changing the "--revision=fp16" to "main" or by removing this argument it should work.

That worked, thanks for helping.