Comparison Of Blip2 Captioning Models With 1 Click Windows & RunPod Installer
Tags: beginners, programming, tutorial, ai
Published: 2024-02-12 15:13:56

<p>I have recently coded from a scratch Gradio app for the famous Blip2 captioning models.</p>

<p>1 Click auto installers with instructions are posted here :&nbsp;<a href="https://www.patreon.com/posts/sota-image-for-2-90744385" rel="noopener ugc nofollow" target="_blank">https://www.patreon.com/posts/sota-image-for-2-90744385</a></p>

<p><a href="https://www.patreon.com/posts/sota-image-for-2-90744385" rel="noopener ugc nofollow" target="_blank">This post&nbsp;</a>also have 1 click Windows &amp; RunPod installers with Gradio interfaces supporting batch captioning as well for the following image vision models : LLaVA (4-bit, 8-bit, 16-bit, 7b, 13b, 34b), Qwen-VL (4-bit, 8-bit, 16-bit), Clip_Interrogator Gradio APP that supports 115 Clip Vision models with combination of 5 caption models.</p>

<p>All precisions are working on Windows as well with our special installers.</p>

<p>16-bit mode works fastest meanwhile 8-bit mode works slowest. 4-bit mode is slower than 16-bit precision but faster than 8-bit precision.</p>

<p>Look at all the information below.</p>

<h1>Blip 2 Models Batch Image Captioning App</h1>

<p>The testings are as below.</p>

<p>When doing batch processing, only 1 image at a time is captioned. So there weren&#39;t parallel captioning of images.</p>

<h2>Salesforce/blip2-opt-6.7b &mdash; 16-bit precision</h2>

<p>Batch processing speed on RTX A6000 : Speed: 0.32 second/image</p>

<p><img alt="" src="https://miro.medium.com/v2/resize:fit:875/1*o3JPh2Da-_bdijucQc_hxA.png" style="height:399px; width:700px" /></p>

<h2>Salesforce/blip2-opt-6.7b &mdash; 8-bit precision</h2>

<p>Batch processing speed on RTX A6000 : Speed: 1.7 second/image</p>

<p><img alt="" src="https://miro.medium.com/v2/resize:fit:875/1*iE5nwcLOhxcBNBMfcH11tw.png" style="height:405px; width:700px" /></p>

<h2>Salesforce/blip2-opt-6.7b &mdash; 4-bit precision</h2>

<p>Batch processing speed on RTX A6000 : Speed: 0.65 second/image</p>

<p><img alt="" src="https://miro.medium.com/v2/resize:fit:875/1*glfI1mxxDWiSKUW0xDaVnw.png" style="height:396px; width:700px" /></p>

<h2>Salesforce/blip2-flan-t5-xxl&mdash; 16-bit precision</h2>

<p>Batch processing speed on RTX A6000 : Speed: 0.41 second/image</p>

<p><img alt="" src="https://miro.medium.com/v2/resize:fit:875/1*YcPfxsIVwbPbGB9PZsKx-w.png" style="height:409px; width:700px" /></p>

<h2>Salesforce/blip2-flan-t5-xxl &mdash; 8-bit precision</h2>

<p>Batch processing speed on RTX A6000 : Speed: 1.6 second/image</p>

<p><img alt="" src="https://miro.medium.com/v2/resize:fit:875/1*roNWZVRfl-I5rfMGaT8IYA.png" style="height:403px; width:700px" /></p>

<h2>Salesforce/blip2-flan-t5-xxl &mdash; 4-bit precision</h2>

<p>Batch processing speed on RTX A6000 : Speed: 0.82 second/image</p>

<p><img alt="" src="https://miro.medium.com/v2/resize:fit:875/1*LtUVcPGHIwX3PsOTFwSq5A.png" style="height:404px; width:700px" /></p>

<h2>Salesforce/blip2-opt-6.7b-coco&mdash; 16-bit precision</h2>

<p>Batch processing speed on RTX A6000 : Speed: 0.39 second/image</p>

<p><img alt="" src="https://miro.medium.com/v2/resize:fit:875/1*tc4JNK-D7Fg3bxMny80OWw.png" style="height:403px; width:700px" /></p>

<h2>Salesforce/blip2-opt-6.7b-coco &mdash; 8-bit precision</h2>

<p>Batch processing speed on RTX A6000 : Speed: 2.01 second/image</p>

<p><img alt="" src="https://miro.medium.com/v2/resize:fit:875/1*ilCCfeP_3zwqPs9RduKiJQ.png" style="height:408px; width:700px" /></p>

<h2>Salesforce/blip2-opt-6.7b-coco &mdash; 4-bit precision</h2>

<p>Batch processing speed on RTX A6000 : Speed: 0.74 second/image</p>

<p><img alt="" src="https://miro.medium.com/v2/resize:fit:875/1*ClJ6SCIGVo9_PdAb2R6nqg.png" style="height:398px; width:700px" /></p>