Space: Affaan/Autocaptioning-with-Inpainting-ImgGen
title: Autocaptioning With Inpainting ImgGen (A Sparrow projekt)
sdk: gradio
license: mit
short_description: Caption guided image editing with transformers & diffusers.
Method: Uses a local transformers captioning model to generate captions for input images., Using the image + generated caption we generate an output image using a local diffusers inpainting pipeline., optionally treat the painted mask as the OBJECT TO KEEP (i.e. preserve the masked object while regenerating the background based on the generated caption). This is implemented by inverting the mask before sending to the inpainting model. 
Tags: gradio, region:us