287 13 112

Sayak Paul

sayakpaul

https://sayak.dev

RisingSayak

sayakpaul

AI & ML interests

Diffusion models, representation learning

Articles

🤗 PEFT: Parameter-Efficient Fine-Tuning of Billion-Scale Models on Low-Resource Hardware

Feb 10, 2023

• 20

A Dive into Pretraining Strategies for Vision-Language Models

Feb 3, 2023

• 26

The State of Computer Vision at Hugging Face 🤗

Jan 30, 2023

• 3

Using LoRA for Efficient Stable Diffusion Fine-Tuning

Jan 26, 2023

• 19

Image Similarity with Hugging Face Datasets and Transformers

Jan 16, 2023

• 6

Deploying 🤗 ViT on Vertex AI

Aug 19, 2022

• 1

Deploying 🤗 ViT on Kubernetes with TF Serving

Aug 11, 2022

Deploying TensorFlow Vision Models in Hugging Face with TF Serving

Jul 25, 2022

Organizations

sayakpaul's activity

New activity in diffusers/community-pipelines-mirror 3 days ago

Revert incorrect commit

#2 opened 3 days ago by

Wauplin

New activity in stabilityai/stable-diffusion-3-medium 4 days ago

fix the diffusers documentation link

#73 opened 4 days ago by

sayakpaul

New activity in stabilityai/stable-diffusion-3-medium-diffusers 4 days ago

fix the documentation link

#12 opened 4 days ago by

sayakpaul

Delete transformer/diffusion_pytorch_model-00001-of-00002.safetensors

#11 opened 4 days ago by

sayakpaul

Upload folder using huggingface_hub

#7 opened 4 days ago by

sayakpaul

Upload folder using huggingface_hub

#6 opened 4 days ago by

sayakpaul

Upload folder using huggingface_hub

#5 opened 4 days ago by

sayakpaul

New activity in stabilityai/stable-diffusion-3-medium 4 days ago

Update README.md to include a note on diffusers

#62 opened 4 days ago by

sayakpaul

New activity in stabilityai/stable-diffusion-3-medium-diffusers 4 days ago

Upload folder using huggingface_hub

#4 opened 4 days ago by

sayakpaul

New activity in mapo-t2i/mapo-pick-safety 6 days ago

Update README for MaPO Pick-Safety checkpoint

#1 opened 8 days ago by

JW17

New activity in mapo-t2i/pick-safety 7 days ago

Add disclaimer for harmful contents

#2 opened 7 days ago by

JW17

New activity in mapo-t2i/pick-style-cartoon 7 days ago

Initial update for Pick-Style cartoon split

#1 opened 9 days ago by

JW17

New activity in mapo-t2i/pick-safety 7 days ago

Update model card for Pick-Safety

#1 opened 9 days ago by

JW17

New activity in mapo-t2i/pick-style-pixel-art 7 days ago

Update dataset card for pixel art split

#1 opened 9 days ago by

JW17

New activity in mapo-t2i/mapo-pick-style-cartoon 7 days ago

Update README for Pick-Style cartoon split MaPO checkpoint

#1 opened 8 days ago by

JW17

New activity in mapo-t2i/mapo-pick-style-pixel-art 7 days ago

Update README for pixel art MaPO checkpoint

#1 opened 8 days ago by

JW17

New activity in diffusers/community-pipelines-mirror 9 days ago

Create README.md

#1 opened 9 days ago by

Wauplin

New activity in anyMODE/extraMODE-PixArtSigma 9 days ago

Hello from the 🧨 Diffusers team

#1 opened 9 days ago by

sayakpaul

New activity in hf-internal-testing/tiny-sdxl-custom-all 19 days ago

Update unet/my_unet_model.py

#4 opened 20 days ago by

sayakpaul

New activity in huggingface/documentation-images 20 days ago

Marigold for ControlNet example images

#341 opened 20 days ago by

toshas

marigold documentation files

#338 opened 22 days ago by

toshas

marigold documentation files (2)

#339 opened 21 days ago by

toshas

marigold documentation files (3)

#340 opened 21 days ago by

toshas

New activity in diffusers/stable-diffusion-xl-inpainting 26 days ago

🚩 Report: Not working

#34 opened 2 months ago by

bgonani1

New activity in PixArt-alpha/PixArt-Sigma-XL-2-1024-MS 29 days ago

Add LoRAs

#1 opened 30 days ago by

AeroDEmi

New activity in diffusers/tuxemon about 1 month ago

Update README.md

#1 opened about 1 month ago by

linoyts

New activity in latent-consistency/lcm-lora-sdxl about 1 month ago

Training details

#12 opened 5 months ago by

ywlee88

New activity in hf-internal-testing/diffusers-images about 1 month ago

Upload lcm_lora/sdxl_lcm_lora.png with huggingface_hub

#39 opened about 1 month ago by

sayakpaul

New activity in madebyollin/taesd-x4-upscaler about 1 month ago

Training code

#1 opened about 2 months ago by

sayakpaul

New activity in huggingface/documentation-images about 1 month ago

Upload header_collage_sigma.jpg

#333 opened about 1 month ago by

Lawrence-cj

New activity in TIGER-Lab/GenAI-Arena about 2 months ago

PixArt Sigma?

#11 opened about 2 months ago by

sayakpaul

New activity in diffusers/controlnet-canny-sdxl-1.0 about 2 months ago

Using non square images for training

#35 opened about 2 months ago by

starinskycc

When generating indoor images, there is unexpected glowing. Can this be fixed?

#34 opened about 2 months ago by

starinskycc

New activity in huggingface/documentation-images about 2 months ago

3 image samples for huggingface InstantStyle documentation

#331 opened about 2 months ago by

danny7017

New activity in diffusers/unofficial-SDXL-Turbo-i2i-t2i about 2 months ago

Any additional configuration to achieve this speed?

#7 opened about 2 months ago by

jduke99

commented a paper about 2 months ago

Layer Skip: Enabling Early Exit Inference and Self-Speculative Decoding

Paper • 2404.16710 • Published Apr 25 • 56 •

New activity in diffusers/controlnet-depth-sdxl-1.0 about 2 months ago

Fix higher vRAM usage

#10 opened about 2 months ago by

tolgacangoz

New activity in huggingface/diffusers-metadata about 2 months ago

order JSON lines before uploading it so that the generated JSON file is stable

#2 opened about 2 months ago by

julien-c

New activity in TIGER-Lab/GenAI-Arena 2 months ago

Make the preference data for text-to-image models available?

#7 opened 2 months ago by

sayakpaul

New activity in huggingface/documentation-images 3 months ago

Files for documentation of Block LoRA (PR: https://github.com/huggingface/diffusers/pull/7352)

#310 opened 3 months ago by

UmerHA

New activity in SPRIGHT-T2I/spright-t2i-sd2 3 months ago

update Readme

#1 opened 3 months ago by

gabsm

New activity in SPRIGHT-T2I/spright_coco 3 months ago

updating readme

#1 opened 3 months ago by

agneet

New activity in SPRIGHT-T2I/README 3 months ago

minor changes

#2 opened 3 months ago by

agneet

New activity in SPRIGHT-T2I/spright 3 months ago

updating cc+sa data card

#3 opened 3 months ago by

agneet

Minor refactoring to the dataset card

#2 opened 3 months ago by

sayakpaul

Update README.md

#1 opened 3 months ago by

sayakpaul

New activity in diffusers/compute-pipeline-size 3 months ago

Seeking feedback

#2 opened 3 months ago by

sayakpaul

New activity in sayakpaul/demo-docker-gradio 3 months ago

fix outdated gr.inputs and gr.outputs

#2 opened 3 months ago by

chansung

New activity in hf-internal-testing/tiny-sdxl-custom-all 3 months ago

Update implementation so that it actually uses the custom classes

#3 opened 3 months ago by

sayakpaul

New activity in huggingface/HuggingDiscussions 3 months ago

[FEEDBACK] Collections

#12 opened 10 months ago by

victor

New activity in lysandre/github-release 3 months ago

append "all commits"

#4 opened 3 months ago by

sayakpaul

New activity in diffusers/compute-pipeline-size 4 months ago

Fetch files metadata directly from model_info call

#1 opened 4 months ago by

Wauplin

New activity in sayakpaul/mgie 4 months ago

How to run your code?

#1 opened 4 months ago by

Andyrasika

New activity in diffusers/pokemon-gpt4-captions 4 months ago

image / caption shift

#3 opened 4 months ago by

p-conscious

New activity in ali-vilab/i2vgen-xl 4 months ago

Update README.md

#11 opened 4 months ago by

sayakpaul

Update config.json of UNet to include `attention_head_dim`

#12 opened 4 months ago by

sayakpaul

Update README.md

#10 opened 4 months ago by

sayakpaul

commented a paper 4 months ago

Rethinking FID: Towards a Better Evaluation Metric for Image Generation

Paper • 2401.09603 • Published Nov 30, 2023 • 13 •

New activity in ali-vilab/i2vgen-xl 4 months ago

requirements?

#7 opened 4 months ago by

vladmandic

Update with fp16 variants

#8 opened 4 months ago by

sayakpaul

Sayak Paul

AI & ML interests

Articles

🧨 Diffusers welcomes Stable Diffusion 3

🤗 PEFT welcomes new merging methods

Welcome aMUSEd: Efficient Text-to-Image Generation

SDXL in 4 steps with Latent Consistency LoRAs

Personal Copilot: Train Your Own Coding Assistant

Exploring simple optimizations for SDXL

Finetune Stable Diffusion Models with DDPO via TRL

Introducing Würstchen: Fast Diffusion for Image Generation

Efficient Controllable Generation for SDXL with T2I-Adapters

Happy 1st anniversary 🤗 Diffusers!

Optimizing Stable Diffusion for Intel CPUs with NNCF and 🤗 Optimum

Instruction-tuning Stable Diffusion with InstructPix2Pix

Training a language model with 🤗 Transformers using TensorFlow and TPUs

ControlNet in Diffusers 🧨

🤗 PEFT: Parameter-Efficient Fine-Tuning of Billion-Scale Models on Low-Resource Hardware

A Dive into Pretraining Strategies for Vision-Language Models

The State of Computer Vision at Hugging Face 🤗

Using LoRA for Efficient Stable Diffusion Fine-Tuning

Image Similarity with Hugging Face Datasets and Transformers

Deploying 🤗 ViT on Vertex AI

Deploying 🤗 ViT on Kubernetes with TF Serving

Deploying TensorFlow Vision Models in Hugging Face with TF Serving

Organizations

sayakpaul's activity

Revert incorrect commit

fix the diffusers documentation link

fix the documentation link

Delete transformer/diffusion_pytorch_model-00001-of-00002.safetensors

Upload folder using huggingface_hub

Upload folder using huggingface_hub

Upload folder using huggingface_hub

Update README.md to include a note on diffusers

Upload folder using huggingface_hub

Update README for MaPO Pick-Safety checkpoint

Add disclaimer for harmful contents

Initial update for Pick-Style cartoon split

Update model card for Pick-Safety

Update dataset card for pixel art split

Update README for Pick-Style cartoon split MaPO checkpoint

Update README for pixel art MaPO checkpoint

Create README.md

Hello from the 🧨 Diffusers team

Update unet/my_unet_model.py

Marigold for ControlNet example images

marigold documentation files

marigold documentation files (2)

marigold documentation files (3)

🚩 Report: Not working

Add LoRAs

Update README.md

Training details

Upload lcm_lora/sdxl_lcm_lora.png with huggingface_hub

Training code

Upload header_collage_sigma.jpg

PixArt Sigma?

Using non square images for training

When generating indoor images, there is unexpected glowing. Can this be fixed?

3 image samples for huggingface InstantStyle documentation

Any additional configuration to achieve this speed?

Fix higher vRAM usage

order JSON lines before uploading it so that the generated JSON file is stable

Make the preference data for text-to-image models available?

Files for documentation of Block LoRA (PR: https://github.com/huggingface/diffusers/pull/7352)

update Readme

updating readme

minor changes

updating cc+sa data card

Minor refactoring to the dataset card

Update README.md

Seeking feedback

fix outdated gr.inputs and gr.outputs

Update implementation so that it actually uses the custom classes

[FEEDBACK] Collections

append "all commits"

Fetch files metadata directly from model_info call

How to run your code?

image / caption shift