How to Download (wget) Models from CivitAI & Hugging Face (HF) & upload into HF including privates
Tags: tutorial, cloud, ai, beginners
Published: 2024-05-23 20:25:13

<h1 style="margin-left:0px;"><strong>How to download models from CivitAI (including behind a login) and Hugging Face (including private repos) into cloud services such as Google Colab, Kaggle, RunPod, Massed Compute and upload models / files to your Hugging Face repo full Tutorial</strong></h1>
<p style="margin-left:0px;"><a target="_blank" rel="noopener noreferrer" href="https://youtu.be/X5WVZ0NMaTg"><u>https://youtu.be/X5WVZ0NMaTg</u></a></p>
<p style="margin-left:0px;"><a target="_blank" rel="noopener noreferrer" href="https://youtu.be/X5WVZ0NMaTg"><u>How to Download (wget) Models from CivitAI &amp; Hugging Face (HF) &amp; upload into HF including privates</u></a></p>
<p style="margin-left:0px;">Hugging Face Download / Upload Notebook File (fully shown in the video) ⤵</p>
<p style="margin-left:0px;"><a target="_blank" rel="noopener noreferrer" href="https://www.patreon.com/posts/hugging-face-and-104672510"><u>https://www.patreon.com/posts/hugging-face-and-104672510</u></a></p>
<p style="margin-left:0px;">-</p>
<p style="margin-left:auto;">{% embed https://youtu.be/X5WVZ0NMaTg %}</p>
<p style="margin-left:0px;">If you are having trouble to download models onto your cloud platforms such as RunPod, Google Colab, Kaggle, Massed Compute or anywhere, this tutorial is made for you. Moreover, you can upload your files / models into your private Hugging Face repository and save them permanently privately and download them super fast. By following this tutorial, you will be able to download CivitAI models that requires login. So with this tutorial you will be able to download and upload even private models from and to Hugging Face and also download models from CivitAI whether public or behind login by using wget command and a specially crafted JupteryLab notebook.</p>
<p style="margin-left:0px;">The logic explained in this video works for every kind of files that you can download via a URL onto any cloud platform that supports wget command.</p>
<p style="margin-left:0px;">Hugging Face Download / Upload Notebook File (fully shown in the video) ⤵</p>
<p style="margin-left:0px;"><a target="_blank" rel="noopener noreferrer" href="https://www.patreon.com/posts/hugging-face-and-104672510"><u>https://www.patreon.com/posts/hugging-face-and-104672510</u></a></p>
<p style="margin-left:0px;">0:00 Introduction to the ultimate model download / upload tutorial to the cloud services</p>
<p style="margin-left:0px;">0:32 How to download public model from CivitAI onto cloud services e.g. RunPod</p>
<p style="margin-left:0px;">0:50 How to understand if a CivitAI model requires login and thus API token</p>
<p style="margin-left:0px;">1:03 Download a public model onto RunPod</p>
<p style="margin-left:0px;">1:20 How to use wget command to download models / files</p>
<p style="margin-left:0px;">2:03 How to download a public model onto Massed Compute</p>
<p style="margin-left:0px;">2:30 How to download a public model into desired folder in Google Colab</p>
<p style="margin-left:0px;">2:43 How to compose a directory / folder on Google Colab</p>
<p style="margin-left:0px;">2:51 The Google Colab’s pathing directory / folder logic</p>
<p style="margin-left:0px;">3:03 How to navigate between folders / directories of Google Colab</p>
<p style="margin-left:0px;">3:13 Start download on Google Colab with wget in desired directory</p>
<p style="margin-left:0px;">3:31 How to compose a directory / folder on a Kaggle notebook</p>
<p style="margin-left:0px;">3:41 The Kaggle’s pathing directory / folder logic</p>
<p style="margin-left:0px;">3:51 How to navigate between folders / directories of Google Colab</p>
<p style="margin-left:0px;">4:01 Start download on Google Colab with wget in desired directory</p>
<p style="margin-left:0px;">4:17 How to utilize / use Kaggle’s temporary disk space</p>
<p style="margin-left:0px;">5:24 How to download files / models from a public Hugging Face repository into the cloud services such as Google Colab</p>
<p style="margin-left:0px;">7:00 How to download models / files on Windows</p>
<p style="margin-left:0px;">7:18 How to download models from CivitAI that requires login into cloud services such as Kaggle</p>
<p style="margin-left:0px;">7:42 How to get your CivitAI API key for free to download models</p>
<p style="margin-left:0px;">8:02 How to format wget download link with API Key to download models behind a login on CivitAI</p>
<p style="margin-left:0px;">8:55 How to download models / files from Hugging Face private repositories easy way</p>
<p style="margin-left:0px;">10:04 How to download models / files from Hugging Face private repositories by using HF API with a very advanced Jupyter notebook</p>
<p style="margin-left:0px;">10:29 How to use HF notebook file on RunPod</p>
<p style="margin-left:0px;">10:44 How to understand if Jupyter notebook cell execution completed or still running</p>
<p style="margin-left:0px;">10:59 How to get your Hugging Face API token key and login in the Jupyter notebook</p>
<p style="margin-left:0px;">11:27 How to download entire private repository via the Jupyter notebook on RunPod</p>
<p style="margin-left:0px;">12:06 How to upload files or folders to your Hugging Face repository — can be both private or public</p>
<p style="margin-left:0px;">12:43 How to use Hugging Face uploader / downloader notebook on Massed Compute</p>
<p style="margin-left:0px;">13:17 How to use Hugging Face uploader / downloader notebook on Kaggle</p>
<p style="margin-left:0px;">14:45 How to upload a file / folder in Kaggle to the Hugging Face — you can use this to save your trained models as well</p>
<p style="margin-left:0px;">15:19 Importance of repository type on Hugging Face</p>
<p style="margin-left:0px;">16:15 How to use Hugging Face uploader / downloader notebook on Google Colab</p>
<p style="margin-left:0px;">16:25 Install cell is mandatory on all platforms</p>
<p style="margin-left:0px;">16:55 How to select / set download folder path on Google Colab</p>
<p style="margin-left:0px;">17:25 How to use Hugging Face uploader / downloader notebook on Windows PC locally</p>
<p style="margin-left:0px;">17:35 How to install JupyterLab on Windows to be able to use notebooks</p>
<p style="margin-left:0px;">17:50 How to open Jupyter notebook on JupteryLab interface</p>
<p style="margin-left:0px;">18:10 How to set folder paths on Windows in Hugging Face uploader / downloader notebook</p>
<p style="margin-left:0px;">18:42 Why put “r” letter to the front of folder paths on Windows</p>
<p style="margin-left:0px;">Title: How to Download Models from CivitAI and Hugging Face onto Cloud Services and Personal Computers</p>
<p style="margin-left:0px;">Summary:</p>
<p style="margin-left:0px;">This comprehensive video tutorial demonstrates how to download machine learning models from CivitAI and Hugging Face onto various cloud computing platforms such as RunPod, Massed Compute, Kaggle, and Google Colab, as well as personal computers. It covers downloading both public and login-protected models from CivitAI, and models from public and private repositories on Hugging Face. The tutorial also shows how to upload models to Hugging Face.</p>
<p style="margin-left:0px;">Key Steps:</p>
<p style="margin-left:0px;">Downloading public models from CivitAI:</p>
<p style="margin-left:0px;">Right-click the download link and copy the URL</p>
<p style="margin-left:0px;">Use the wget command in the terminal with the URL in double quotes</p>
<p style="margin-left:0px;">Optionally specify a custom file name using the -O flag</p>
<p style="margin-left:0px;">Paste the command and execute it to start the download</p>
<p style="margin-left:0px;">Downloading login-protected models from CivitAI:</p>
<p style="margin-left:0px;">Generate an API token in your CivitAI account settings</p>
<p style="margin-left:0px;">Append ?token=your_API_token to the model download URL</p>
<p style="margin-left:0px;">Use the modified URL with the wget command to download the model</p>
<p style="margin-left:0px;">Downloading models from public Hugging Face repositories:</p>
<p style="margin-left:auto;">
    <picture>
        <source srcset="https://miro.medium.com/v2/resize:fit:640/format:webp/1*VcB2Hxjvu5tsdvKfbvydBg.png 640w, https://miro.medium.com/v2/resize:fit:720/format:webp/1*VcB2Hxjvu5tsdvKfbvydBg.png 720w, https://miro.medium.com/v2/resize:fit:750/format:webp/1*VcB2Hxjvu5tsdvKfbvydBg.png 750w, https://miro.medium.com/v2/resize:fit:786/format:webp/1*VcB2Hxjvu5tsdvKfbvydBg.png 786w, https://miro.medium.com/v2/resize:fit:828/format:webp/1*VcB2Hxjvu5tsdvKfbvydBg.png 828w, https://miro.medium.com/v2/resize:fit:1100/format:webp/1*VcB2Hxjvu5tsdvKfbvydBg.png 1100w, https://miro.medium.com/v2/resize:fit:1400/format:webp/1*VcB2Hxjvu5tsdvKfbvydBg.png 1400w" type="image/webp" sizes="(min-resolution: 4dppx) and (max-width: 700px) 50vw, (-webkit-min-device-pixel-ratio: 4) and (max-width: 700px) 50vw, (min-resolution: 3dppx) and (max-width: 700px) 67vw, (-webkit-min-device-pixel-ratio: 3) and (max-width: 700px) 65vw, (min-resolution: 2.5dppx) and (max-width: 700px) 80vw, (-webkit-min-device-pixel-ratio: 2.5) and (max-width: 700px) 80vw, (min-resolution: 2dppx) and (max-width: 700px) 100vw, (-webkit-min-device-pixel-ratio: 2) and (max-width: 700px) 100vw, 700px">
        <source srcset="https://miro.medium.com/v2/resize:fit:640/1*VcB2Hxjvu5tsdvKfbvydBg.png 640w, https://miro.medium.com/v2/resize:fit:720/1*VcB2Hxjvu5tsdvKfbvydBg.png 720w, https://miro.medium.com/v2/resize:fit:750/1*VcB2Hxjvu5tsdvKfbvydBg.png 750w, https://miro.medium.com/v2/resize:fit:786/1*VcB2Hxjvu5tsdvKfbvydBg.png 786w, https://miro.medium.com/v2/resize:fit:828/1*VcB2Hxjvu5tsdvKfbvydBg.png 828w, https://miro.medium.com/v2/resize:fit:1100/1*VcB2Hxjvu5tsdvKfbvydBg.png 1100w, https://miro.medium.com/v2/resize:fit:1400/1*VcB2Hxjvu5tsdvKfbvydBg.png 1400w" sizes="(min-resolution: 4dppx) and (max-width: 700px) 50vw, (-webkit-min-device-pixel-ratio: 4) and (max-width: 700px) 50vw, (min-resolution: 3dppx) and (max-width: 700px) 67vw, (-webkit-min-device-pixel-ratio: 3) and (max-width: 700px) 65vw, (min-resolution: 2.5dppx) and (max-width: 700px) 80vw, (-webkit-min-device-pixel-ratio: 2.5) and (max-width: 700px) 80vw, (min-resolution: 2dppx) and (max-width: 700px) 100vw, (-webkit-min-device-pixel-ratio: 2) and (max-width: 700px) 100vw, 700px"><img class="image_resized" style="height:auto;width:680px;" src="https://miro.medium.com/v2/resize:fit:1313/1*VcB2Hxjvu5tsdvKfbvydBg.png" alt="" width="700" height="394">
    </picture>
</p>