SVDiff

Open-Source Replication of SVDiff (https://arxiv.org/abs/2303.11305)


oft

Official implementation of "Controlling Text-to-Image Diffusion by Orthogonal Finetuning".


Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"


Sytan-SDXL-ComfyUI

A hub dedicated to development and upkeep of the Sytan SDXL workflow for ComfyUI


sky-follower-bridge

Instantly find and follow the same users from your X(Twitter) follower on Bluesky.


NeuralWaveMachines

Official Implementation of the ICML 2023 paper: "Neural Wave Machines: Learning Spatiotemporally Structured Representations with Locally Coupled Oscillatory Recurrent Neural Networks"


HQTrack

Tracking Anything in High Quality


inanimate

Generate images from an initial frame and text


imgbrd-grabber

Very customizable imageboard/booru downloader with powerful filenaming features.


hyperdreambooth

Implementation of HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Models


FlexFlow

FlexFlow Serve: Low-Latency, High-Performance LLM Serving


pyempaq

A simple but powerful Python packer to run any project with any virtualenv dependencies anywhwere.


Michelangelo

[NeurIPS 2023] Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representation


whisper-at

Code and Pretrained Models for Interspeech 2023 Paper "Whisper-AT: Noise-Robust Automatic Speech Recognizers are Also Strong Audio Event Taggers"


ARLDM

Official Pytorch Implementation of Synthesizing Coherent Story with Auto-Regressive Latent Diffusion Models


NVDS

The official repository of the ICCV2023 paper "Neural Video Depth Stabilizer" (NVDS).


mPLUG-Owl

mPLUG-Owl & mPLUG-Owl2: Modularized Multimodal Large Language Model


comfy-plasma

A simple plasma noise generator for ComfyUI


chirho

An experimental language for causal reasoning


Tri-MipRF

Tri-MipRF: Tri-Mip Representation for Efficient Anti-Aliasing Neural Radiance Fields, ICCV'23 (Oral, Best Paper Finalist)


scaled-rope

Lora


Inference Llama 2 in one file of pure C


TTVSR

[CVPR'22 Oral] TTVSR: Learning Trajectory-Aware Transformer for Video Super-Resolution


RVRT

Recurrent Video Restoration Transformer with Guided Deformable Attention (NeurlPS2022, official repository)


koboldcpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI


Promptvision

Local viewer for Stable Diffusion generated images (with EXIF data) built with Streamlit.


SdPaint

Stable Diffusion Painting


RACplusplus

A high performance implementation of Reciprocal Agglomerative Clustering in C++


graphlearn-for-pytorch

A GPU-accelerated graph learning library for PyTorch, facilitating the scaling of GNN training and inference.


feathub

FeatHub - A stream-batch unified feature store for real-time machine learning


FederatedScope

An easy-to-use federated learning platform


TinyNeuralNetwork

TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.


AliceMind

ALIbaba's Collection of Encoder-decoders from MinD (Machine IntelligeNce of Damo) Lab


dolphin

General video interaction platform based on LLMs, including Video ChatGPT


AMT

Official code for "AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolation" (CVPR2023)


ReLA

[CVPR2023 Highlight] GRES: Generalized Referring Expression Segmentation


[ICCV 2023] Unsupervised Compositional Concepts Discovery with Text-to-Image Generative Models


meh

Merging Execution Helper


Adaptation of the merging method described in the paper - Git Re-Basin: Merging Models modulo Permutation Symmetries (https://arxiv.org/abs/2209.04836) for Stable Diffusion


Collaborative-Diffusion

Collaborative Diffusion (CVPR 2023)


bicubic-plusplus

Bicubic++ (NTIRE @ CVPR 2023, Real Time Super Resolution Track 2 winner)


VPD

[ICCV 2023] VPD is a framework that leverages the high-level and low-level knowledge of a pre-trained text-to-image diffusion model to downstream visual perception tasks.


VI-Depth

Code for Monocular Visual-Inertial Depth Estimation (ICRA 2023)


guided-inpainting

Towards Unified Keyframe Propagation Models


sd-webui-llul

LLuL - Local Latent upscaLer


nginx-ui

Yet another WebUI for Nginx


clip-interrogator-ext

Stable Diffusion WebUI extension for CLIP Interrogator


sd-webui-panorama-viewer

Sends rendered SD_auto1111 images quickly to this panorama (hdri, equirectangular) viewer


stable-diffusion-webui-composable-lora

This extension replaces the built-in LoRA forward procedure.


stable-diffusion-webui-ipynb

AUTOMATIC1111 Stable Diffusion WebUI 1.5 + Kohya's Scripts


sd-webui-lora-masks

Apply unlimited masks to unlimited LoRA models


sqlitebrowser

Official home of the DB Browser for SQLite (DB4S) project. Previously known as "SQLite Database Browser" and "Database Browser for SQLite". Website at:


stable-diffusion-nix

A fully reproducible nix flake for automatic1111/stable-diffusion-webui with CUDA support.


This is the tandem repository to exploit on linux the kohya_ss training webui converted to Linux. It uses the fork in the following link


Video-Diffusion-WebUI

Video Diffusion WebUI: Text2Video + Image2Video + Video2Video WebUI


MasaCtrl

[ICCV 2023] Consistent Image Synthesis and Editing


fastdvdnet

FastDVDnet: A Very Fast Deep Video Denoising algorithm


Neural Rendering with Attention: An Incremental Improvement for Anime Character Animation


kohya-trainer

Adapted from https://note.com/kohya_ss/n/nbf7ce8d80f29 for easier cloning


MetaTransformer

Meta-Transformer for Unified Multimodal Learning


[ICCV 2023] Text2Tex: Text-driven Texture Synthesis via Diffusion Models


inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.


chat-ui

Open source codebase powering the HuggingChat app


git-lfs-download

Download full or partial git-lfs repos without temporarily using 2x disk space


RetNet

An implementation of "Retentive Network: A Successor to Transformer for Large Language Models"


PTQD

The official implementation of PTQD: Accurate Post-Training Quantization for Diffusion Models


tiny-stable-diffusion

Tiny optimized Stable-diffusion that can run on GPUs with just 1GB of VRAM. (Beta)


[ICCV2023] Delicate Textured Mesh Recovery from NeRF via Adaptive Surface Refinement


OnnxStream

Lightweight inference library for ONNX files, written in C++. It can run SDXL on a RPI Zero 2 but also Mistral 7B on desktops and servers.


X-CLIP

An official implementation for "X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval"


egui

egui: an easy-to-use immediate mode GUI in Rust that runs on both web and native


sd-webui-animatediff

AnimateDiff for AUTOMATIC1111 Stable Diffusion WebUI


prompt-fusion-extension

auto1111 webui extension for all sorts of prompt interpolations!


PyTurboJPEG

PyTurboJPEG is a highly optimized Python wrapper of libjpeg-turbo (TurboJPEG API) which supports x86 and ARM architecture.


rust-web-framework-comparison

A comparison of some web frameworks and libs written in Rust


llama-recipes

Scripts for fine-tuning Llama2 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization & question answering. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment.Demo apps to showcase Llama2 for WhatsApp & Messenger


image-background-remove-tool

✂ Automated high-quality background removal framework for an image using neural networks. ✂


EMA-VFI

[CVPR 2023] Extracting Motion and Appearance via Inter-Frame Attention for Efficient Video Frame Interpolatio


EMA-VFI-WebUI

Advanced AI-Based Video Renovation UI Using EMA-VFI & Real-ESRGAN


llm-toys

Small(7B and below) finetuned LLMs for a diverse set of useful tasks


A custom extension for sd-webui that allow you to generate 3D model from txt or image, basing on OpenAI Shap-E.


sd-webui-prompt-history

Automatic store your generation info with image and apply back anytime.


Clip I/O extension for Stable Diffusion Web UI


sd-fast-pnginfo

Javascript version of webui PNG Info tab


sd-webui-train-tools

The stable diffusion webui training aid extension helps you quickly and visually train models such as Lora.


sd-webui-nulienhance

An extension for integrating the NUl Image Enhancer (NUlIE) in sd-webui 🖼


NUl-Image-Enhancer

An algorithm based on decision trees and deep learning models to enhance images


An Image utils extension for A1111's sd-webui


stable-diffusion-webui-rembg

Removes backgrounds from pictures. Extension for webui.


sd-infinity-grid-generator-script

Infinite-Axis Grid Generator for Stable Diffusion!


molecular-renderer

CAD program for molecular nanotechnology


nvdiffrast

Nvdiffrast - Modular Primitives for High-Performance Differentiable Rendering


sd-dynamic-thresholding

Dynamic Thresholding (CFG Scale Fix) for Stable Diffusion (StableSwarmUI, ComfyUI, and Auto WebUI)


catalogue

Super lightweight function registries for your library


unloop

a co-creative looper that uses generative modeling to **not** repeat itself.


reactpy-jupyter

It's React, but in Jupyter


anywidget

jupyter widgets made easy


VisualRWKV

VisualRWKV is the visual-enhanced version of the RWKV language model, enabling RWKV to handle various visual tasks.


vectordb

A Python vector database you just need - no more, no less.


MS-AMP

Microsoft Automatic Mixed Precision Library


CSD

Collaborative Score Distillation for Consistent Visual Synthesis (NeurIPS 2023)


magvit

Official JAX implementation of MAGVIT: Masked Generative Video Transformer


clifford

Geometric Algebra for Python


xonsh

:shell: Python-powered, cross-platform, Unix-gazing shell.


viztracer

VizTracer is a low-overhead logging/debugging/profiling tool that can trace and visualize your python code execution.


datoviz

⚡ High-performance GPU interactive scientific data visualization with Vulkan


barrier

Open-source KVM software


Remote Frame Buffer for Jupyter


fabric

Simple, Pythonic remote execution and deployment.


jupyterlab-desktop

JupyterLab desktop application, based on Electron.


vkBasalt

a vulkan post processing layer for linux


jupyterlab-sidecar

A sidecar output widget for JupyterLab


pyimgui

Cython-based Python bindings for dear imgui


A library to generate LaTeX expression from Python code.


nbmake

📝 Pytest plugin for testing notebooks


voici

Voici turns any Jupyter Notebook into a static web application


timeshift

System restore tool for Linux. Creates filesystem snapshots using rsync+hardlinks, or BTRFS snapshots. Supports scheduled snapshots, multiple backup levels, and exclude filters. Snapshots can be restored while system is running or from Live CD/USB.


mamba

The Fast Cross-Platform Package Manager


LookingGlass

An extremely low latency KVMFR (KVM FrameRelay) implementation for guests with VGA PCI Passthrough.


FiraCode

Free monospaced font with programming ligatures


fastplotlib

Next-gen fast plotting library running on WGPU using the pygfx rendering engine


pints

Probabilistic Inference on Noisy Time Series


netrep

Some methods for comparing network representations in deep learning and neuroscience.


boardlaw

Scaling scaling laws with board games.


Torchelie

Torchélie is a set of utility functions, layers, losses, models, trainers and other things for PyTorch.


pyvene

Stanford NLP Python Library for Understanding and Improving PyTorch Models via Interventions


geotorch

Constrained optimization toolkit for PyTorch


elastic-ai.creator

elastic ai.creator


paige

Powerful, pliable pixel perfection. An advanced Hugo theme.


LoRAnanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.


trojanzoo

TrojanZoo provides a universal pytorch platform to conduct security researches (especially backdoor attacks/defenses) of image classification in deep learning.


twarc

A command line tool (and Python library) for archiving Twitter JSON


langchain-problems

Demos of some issues with LangChain.


eden-sd-pipelines

Development repo for Eden's SD pipelines (built on top of custom diffusers fork)


san

PyTorch implementation of slicing adversarial network (SAN)


Emu

Emu Series: Generative Multimodal Models from BAAI


llm-rs-python

Unofficial python bindings for the rust llm library. 🐍❤🦀


curated-transformers

🤖 A PyTorch library of curated Transformer models and their composable components


relora

Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates


efficient-dl-systems

Efficient Deep Learning Systems course materials (HSE, YSDA)


Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs


microvenv

A minimal re-implementation of Python's `venv` module


go-ggml-transformers.cpp

Binding to transformers in ggml


MorphoSymm

Tools for exploiting Morphological Symmetries in robotics


Source code for the paper: "AutoDecoding Latent 3D Diffusion Models"


nitter

Alternative Twitter front-end


Hrrformer

Hrrformer: A Neuro-symbolic Self-attention Model (ICML23)


ODISE

Official PyTorch implementation of ODISE: Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Models [CVPR 2023 Highlight]


Hammer

An efficient toolkit for training deep models.


AnimateDiff

Official implementation of AnimateDiff.


Using sparse coding to find distributed representations used by neural networks.


DragDiffusion

Official code for DragDiffusion


x-stable-diffusion

Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention. Join our Discord communty: https://discord.com/invite/TgHXuSJEk6


tsfresh

Automatic extraction of relevant features from time series:


aeon

A toolkit for conducting machine learning tasks with time series data


roop-cam

real time face swap and one-click video deepfake with only a single image (Uncensored)


An operation trying to do the opposite of F.grid_sample


MAD

MAD: A Scalable Dataset for Language Grounding in Videos from Movie Audio Descriptions


AutoAD

[CVPR'23 Highlight] AutoAD: Movie Description in Context.


rome

Locating and editing factual associations in GPT (NeurIPS 2022)


FastEdit

🩹Editing large language models within 10 seconds⚡


gaussian-splatting

Original reference implementation of "3D Gaussian Splatting for Real-Time Radiance Field Rendering"


pypdl

A concurrent python downloader with resume capablities


ggml-downloader

Simple, Fast, Parallel Huggingface GGML model downloader written in python


official code of “OpenShape: Scaling Up 3D Shape Representation Towards Open-World Understanding”


torchopt

TorchOpt is an efficient library for differentiable optimization built upon PyTorch.


Nuggt

An Autonomous LLM Agent that runs on Wizcoder-15B


Modules, operators and utilities for 3D neural rendering in single-object, multi-object, categorical and large-scale scenes.


SlicerTomoSAM

An extension of 3D Slicer using the Segment Anything Model (SAM) to aid the segmentation of 3D data from tomography or other imaging techniques.


iceberg

A compositional diagramming and animation library as an eDSL in Python


ddpo-pytorch

DDPO for finetuning diffusion models, implemented in PyTorch with LoRA support


Abysz-LAB-Ext

Temporal Coherence tools. Automatic1111 extension.


automatic1111's stable-diffusion-webui extension for storing images to a database


An extension to AUTOMATIC1111 WebUI for stable diffusion which adds a prompt generator


sd-background-removal

Background removal extension for Automatic1111


HeadTrip-Extension

Deep Dreaming Image and Video into the automatic1111 extension


sd-webui-model-scanner

Automatic1111 extension for sanity and security check of stable diffusion models


sd-webui-pixelart

Pixel art postprocessing extension for stable diffusion AUTOMATIC1111 webui


Config-Presets

Extension for Automatic1111


stable-diffusion-webui-embedding-merge

Extension for AUTOMATIC1111/stable-diffusion-webui for creating and merging Textual Inversion embeddings at runtime from string literals.


Extension for AUTOMATIC1111/stable-diffusion-webui for more control over inpainting, for example disabling overlay composition.


lora-collector

This is an extension for the Stable Diffusion WebUI by AUTOMATIC1111.


Webui Extension for customizing Highres. fix and improve details.


Automatic1111 python script to enhance image quality


guess-what-moves

Guess What Moves: Unsupervised Video and Image Segmentation by Anticipating Motion


Awesome-Open-Vocabulary

A Survey on Open Vocabulary Learning


HIPIE

[NeurIPS2023] Code release for "Hierarchical Open-vocabulary Universal Image Segmentation"


tree-of-thought-llm

[NeurIPS 2023] Tree of Thoughts: Deliberate Problem Solving with Large Language Models


LightGlue

LightGlue: Local Feature Matching at Light Speed (ICCV 2023)


DragonDiffusion

ICLR 2024 (Spotlight)


Co-DETR

[ICCV 2023] DETRs with Collaborative Hybrid Assignments Training


deforumation

A GUI to remotely steer the Deforum motions in real time


ChatGLM-Tuning

基于ChatGLM-6B + LoRA的Fintune方案


gill

🐟 Code and models for the NeurIPS 2023 paper "Generating Images with Multimodal Language Models".


rift

Rift: an AI-native language server for your personal AI software engineer


Bottles

Run Windows software and games on Linux


DragDiffusion

Implementation of DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editing


SFT-PG

Code for "Optimizing DDPM Sampling with Shortcut Fine-Tuning" (https://arxiv.org/abs/2301.13362), ICML 2023


tinydiarize

Minimal extension of OpenAI's Whisper adding speaker diarization with special tokens


Visual-SLAM based on COLMAP API


A Zsh theme


bat

A cat(1) clone with wings.


home-manager

Manage a user environment using Nix  [maintainer=@rycee]


instructor

structured outputs for llms


tet

Implementation of Tracking Every Thing in the Wild, ECCV 2022


S.A.T.U.R.D.A.Y

A toolbox for working with WebRTC, Audio and AI


segment-anything

An unofficial Python package for Meta AI's Segment Anything Model


onnx-tool

A parser, editor and profiler tool for ONNX models.


itables

Pandas DataFrames as Interactive DataTables


linfa

A Rust machine learning framework.


[CVPR 2023] E3DGE: An encoder-based 3D StyleGAN inversion framework.


EasyOCR

Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.


A very simple sketch-based 3D modeling system built with the help of 3DBiCar and RaBit.


sam-pt

SAM-PT: Extending SAM to zero-shot video segmentation with point-based tracking.


MaskFreeVIS

Mask-Free Video Instance Segmentation [CVPR 2023]


DisCo

DisCo: Referring Human Dance Generation in Real World


MUSE-Pytorch

An in-context conditioning version of MUSE with pre-trained checkpoints.


StyleDrop-PyTorch

Unoffical implement for [StyleDrop](https://arxiv.org/abs/2306.00983)


mage

A PyTorch implementation of MAGE: MAsked Generative Encoder to Unify Representation Learning and Image Synthesis


AdaMix

This is the implementation of the paper AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning (https://arxiv.org/abs/2205.12410).


lineax

Linear solvers in JAX and Equinox. https://docs.kidger.site/lineax


tinyvector

A tiny nearest-neighbor embedding database built with SQLite and Pytorch. (In development!)


training-picker

Extension for stable-diffusion-webui that allows the user to mux through the keyframes of a video, and automatically pick and export training examples from individual keyframes.


pycolmap

Python bindings for COLMAP


nvshare

Practical GPU Sharing Without Memory Size Constraints


AdGuardHome

Network-wide ads & trackers blocking DNS server


einconv

Convolutions and more as einsum for PyTorch


hidet

An open-source efficient deep learning framework/compiler, written in python.


sda

Official implementation of Score-based Data Assimilation


dice-mc

DiCE: The Infinitely Differentiable Monte-Carlo Estimator


NeRF-Art

NeRF-Art: Text-Driven Neural Radiance Fields Stylization


vald

Vald.  A Highly Scalable Distributed Vector Search Engine


badslam

Bundle Adjusted Direct RGB-D SLAM


Whisper realtime streaming for long speech-to-text transcription and translation


duckdb

DuckDB is an in-process SQL OLAP Database Management System


dendron

The personal knowledge management (PKM) tool that grows as you do!


FerretDB

A truly Open Source MongoDB alternative


dragonfly

A modern replacement for Redis and Memcached


memgraph

Open-source graph database, built for real-time streaming data, compatible with Neo4j.


smartcore

A comprehensive library for machine learning and numerical computing. The library provides a set of tools for linear algebra, numerical computing, optimization, and enables a generic, powerful yet still efficient approach to machine learning.


evadb

Database system for AI-powered apps


openchat

OpenChat: Advancing Open-source Language Models with Imperfect Data


UltraChat

Large-scale, Informative, and Diverse Multi-round Chat Data (and Models)


LLM-Training-Puzzles

What would you do with 1000 H100s...


embedchain

The Open Source RAG framework


lens

This is the official repository for the LENS (Large Language Models Enhanced to See) system.


sd-webui-qrcode-toolkit

Anthony's QR Toolkit for Stable Diffusion WebUI


Automatic1111 serverless worker.


After-Diffusion

A CEP Extension for Adobe After Effects that allows for seamless integration of the Stable Diffusion Web-UI.


StableHoudini

Stable Diffusion Houdini Toolset


sd-pixel

Quickly and easily perform downscaling, color palette limiting, and other useful pixel art effects through the extras tab.


sd-webui-supermerger

model merge extention for stable diffusion web ui


stable-diffusion-webui-auto-tls-https

An extension for AUTOMATIC1111's Stable Diffusion Web-UI that enables easy or zero-conf TLS for HTTPS


sdwebuiapi

Python API client for AUTOMATIC1111/stable-diffusion-webui


An extension for stable-diffusion-webui to load lycoris models.


control-a-video

Official Implementation of "Control-A-Video: Controllable Text-to-Video Generation with Diffusion Models"


eigenlearning

codebase for "A Theory of the Inductive Bias and Generalization of Kernel Regression and Wide Neural Networks"


reverse-engineering

Example notebooks for Reverse Engineering the Neural Tangent Kernel


generative-models

Generative Models by Stability AI


ComfyUI-BlenderAI-node

Blender Node integration of ComfyUI.


comfyui-plugins

Extensions, Custom Nodes, and other plugins for ComfyUI


sd-webui-comfyui

An extension to integrate ComfyUI workflows into the Webui's pipeline


ComfyUI nodes for the Ultimate Stable Diffusion Upscale script by Coyote-A.


IJCAI2023 - Collaborative Neural Rendering using Anime Character Sheets


Img2img Loopback with Denoise controls over time.


was-node-suite-comfyui

An extensive node suite for ComfyUI with over 190 new nodes


Loopback-Morph

Img2img loopback with advanced Deforum-style prompt and strength scheduling.


MobileSAM

This is the official code for MobileSAM project that makes SAM lightweight for mobile applications and beyond!


t-rec-rs

Blazingly fast terminal recorder that generates animated gif images for the web written in rust


Kooha

Elegantly record your screen


dddetailer

Detection Detailer hijack edition


stable-diffusion-webui-sonar

Wrapped k-diffuison samplers with tricks to improve the generated image quality (maybe?), extension script for AUTOMATIC1111/stable-diffusion-webui


Official repository of "BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignment"


sdweb-merge-board

Multi-step automation merge tool. Extension/Script for Stable Diffusion UI by AUTOMATIC1111 https://github.com/AUTOMATIC1111/stable-diffusion-webui


AUTOMATIC1111 UI extension for creating videos using img2img and ebsynth.


AUTOMATIC1111 UI extension for creating videos synchronized to music.


lora-prompt-tool

A Stable Diffusion webUI extension for manage trigger word for LoRA or other model


sd-webui-prompt-highlight

A Stable Diffusion webUI extension for prompt syntax-highlighting


awsome-sd-webui-plugin

sd-webui-plugin


sd-webui-easy-tag-insert

An Extension for Automatic1111 Webui that helps inserting prompts


sd-webui-aspect-ratio-helper

Simple extension to easily maintain aspect ratio while changing dimensions.  Install via the extensions tab on the AUTOMATIC1111 webui.


sdweb-merge-block-weighted-gui

Merge models with separate rate for each 25 U-Net block (input, middle, output). Extension for Stable Diffusion UI by AUTOMATIC1111


Create masks out of depthmaps in img2img


Make Stable Diffusion web UI console logs available in the web UI.


stable.art

Photoshop plugin for Stable Diffusion with Automatic1111 as backend (locally or with Google Colab)


A progressive upscaling-img2img version of hires.fix, extension script for AUTOMATIC1111/stable-diffusion-webui.


sd-webui-vectorscope-cc

An Extension for Automatic1111 Webui that performs Offset Noise* natively


stable-diffusion-webui-composable-lora

This extension replaces the built-in LoRA forward procedure.


stable-diffusion-webui-distributed

Chains stable-diffusion-webui instances together to facilitate faster image generation.


kohya-sd-scripts-webui

Gradio wrapper for sd-scripts by kohya


sd-webui-infinite-image-browsing

A fast and powerful image/video browser for Stable Diffusion webui and ComfyUI, featuring infinite scrolling and advanced search capabilities using image parameters. It also supports standalone operation.


sd-webui-stablesr

StableSR for Stable Diffusion WebUI - Ultra High-quality Image Upscaler


sd-webui-depth-lib

Depth map library for use with the Control Net extension for Automatic1111/stable-diffusion-webui


sd-webui-segment-anything

Segment Anything for Stable Diffusion WebUI


scc

Sloc, Cloc and Code: scc is a very fast accurate code counter with complexity calculations and COCOMO estimates written in pure Go


playwright-python

Python version of the Playwright testing and automation library.


normalizing-flows

PyTorch implementation of normalizing flow models


OpenTimelineIO

Open Source API and interchange format for editorial timeline information.


Export EDL files from Blender


stable-diffusion-webui-docker

Stable Diffusion WebUI in Docker


Using advances in generative modeling to learn reward functions from unlabeled videos.


google-unlocked

Google Unlocked browser extension uncensor google search results


encodec.cpp

Port of Meta's Encodec in C/C++


clip.cpp

CLIP inference in plain C/C++ with no extra dependencies


btop

A monitor of resources


gtop

System monitoring dashboard for terminal


bottom

Yet another cross-platform graphical process/system monitor.


minTorToiSe

A minimal PyTorch re-implementation of TorToiSe-tts inference


pre-commit-hooks

Some out-of-the-box hooks for pre-commit


rebuff

LLM Prompt Injection Detector


SkinDeep

Get Deinked!!


Source code of CVPR 2023 paper


PanoHead

Code Repository for CVPR 2023 Paper "PanoHead: Geometry-Aware 3D Full-Head Synthesis in 360 degree"


metal-flash-attention

Faster alternative to Metal Performance Shaders


sdfstudio

A Unified Framework for Surface Reconstruction


rwkv

RWKV model implementation


pythreejs

A Jupyter - Three.js bridge


panel-highcharts

📈 The panel-highcharts package makes it easy to use HighCharts in Python, Notebooks and with HoloViz Panel.


mpl-interactions

Sliders to control matplotlib and other interactive goodies. Works in any interactive backend and even uses ipywidgets when in a Jupyter notebook


mito

The mitosheet package, trymito.io, and other public Mito code.


ipywebrtc

WebRTC for Jupyter notebook/lab


ipyvuetify

Jupyter widgets based on vuetify UI components


ipytone

Interactive audio in Jupyter


ipyregulartable

High performance, editable, stylable datagrids in jupyter and jupyterlab


p5.js is a client-side JS platform that empowers artists, designers, students, and anyone to learn to code and express themselves creatively on the web. It is based on the core principles of Processing. http://twitter.com/p5xjs —


jupyterlite

Wasm powered Jupyter running in the browser 💡


ipycanvas

Interactive Canvas in Jupyter


diffvg

Differentiable Vector Graphics Rasterization


DG

Official repo for Discriminator Guidance.


ViT-Slim

Official code for our CVPR'22 paper “Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space”


VectorDBBench

A Benchmark Tool for VectorDB


Consistency models trained on CIFAR-10, in JAX.


FastSAM

Fast Segment Anything


ControlVideo

[ICLR 2024] Official pytorch implementation of "ControlVideo: Training-free Controllable Text-to-Video Generation"


wanda

A simple and effective LLM pruning approach.


robust-dynrf

An algorithm for reconstructing the radiance field of a dynamic scene from a casually-captured video.


sam-hq

Segment Anything in High Quality [NeurIPS 2023]


BundleSDF

[CVPR 2023] BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objects


elk

Keeping language models honest by directly eliciting knowledge encoded in their activations.


weave

Weave, developed by the team at Weights and Biases, is a new open-source toolkit designed for performant, interactive data exploration. Our mission is to equip Machine Learning practitioners with the best tools to turn data into insights quickly and easily.


LART

Code repository for the paper "On the Benefits of 3D Pose and Tracking for Human Action Recognition", (CVPR 2023)


[CVPR 2023] Official implementation of "DATID-3D: Diversity-Preserved Domain Adaptation Using Text-to-Image Diffusion for 3D Generative Model"


gpt-engineer

Specify what you want it to build, the AI asks for clarification, and then builds it.


Unofficial implementation of 2D ProlificDreamer


side-tuning

sidetuning.berkeley.edu


vllm

A high-throughput and memory-efficient inference and serving engine for LLMs


nnx

Neural Networks for JAX


aubio

a library for audio and music analysis


Official Implementation of the Paper: Ego-Body Pose Estimation via Ego-Head Pose Estimation (CVPR 2023)


Lorien

Infinite canvas drawing/whiteboarding app for Windows, Linux and macOS. Made with Godot.


awesome-machine-learning-in-compilers

Must read research papers and links to tools and datasets that are related to using machine learning for compilers and systems optimisation


(ICCV 2021 - oral) Estimating and Exploiting the Aleatoric Uncertainty in Surface Normal Estimation


videocomposer

Official repo for VideoComposer: Compositional Video Synthesis with Motion Controllability


generative-disco

🎼 text-to-video system for music visualization


smplify-x

Expressive Body Capture: 3D Hands, Face, and Body from a Single Image


BEDLAM (CVPR 2023) render pipeline tools


viser

Web-based 3D visualization + Python


stable-diffusion-webui-model-toolkit

A Multipurpose toolkit for managing, editing and creating models.


git-wiki-skeleton

This is a skeleton repository that can be used as a template to bootstrap your wiki using "remote_theme" config


git-wiki-theme

A revolutionary full-featured wiki for github pages and jekyll. You don't need to compile it!


gomin

GOMIN; Gaudio Open Mel-spectrogram Inversion Network


mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video (ICML 2023)


descript-audio-codec

State-of-the-art audio codec with 90x compression factor. Supports 44.1kHz, 24kHz, and 16kHz mono/stereo audio.


CAR

High-Fidelity Clothed Avatar Reconstruction from a Single Image (CVPR2023)


NIKI

Code of "NIKI: Neural Inverse Kinematics with Invertible Neural Networks for 3D Human Pose and Shape Estimation", CVPR 2023


lima

Linux virtual machines, with a focus on running containers


kipoi

Kipoi's model zoo API


The-Art-of-Linear-Algebra

Graphic notes on Gilbert Strang's "Linear Algebra for Everyone"


t-few

Code for T-Few from "Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning"


Fujisaki

An ongoing (fast prototyping) project to create your own doppelgänger based on your Twitter archive and LoRA+Alpaca


brew

🍺 The missing package manager for macOS (or Linux)


torch-quasimetric

PyTorch Package For Quasimetric Learning


flash-attention-jax

Implementation of Flash Attention in Jax


PyTorch-Encoding

A CV toolkit for my papers.


postgresml

The GPU-powered AI application database. Get your app to market faster using the simplicity of SQL and the latest NLP, ML + LLM models.


landmark-attention

Landmark Attention: Random-Access Infinite Context Length for Transformers


landmark-attention-qlora

Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA


vispy

Main repository for Vispy


petgraph

Graph data structure library for Rust.


sd-webui-roop

roop extension for StableDiffusion web-ui


UNSB

Official Repository of "Unpaired Image-to-Image Translation via Neural Schrödinger Bridge" (ICLR 2024)


An unofficial implementation of paper 3D Gaussian Splatting for Real-Time Radiance Field Rendering by taichi lang.


localrf

An algorithm for reconstructing the radiance field of a large-scale scene from a single casually captured video.


pandas-ai

Chat with your data (SQL, CSV, pandas, polars, noSQL, etc). PandasAI makes data analysis conversational using LLMs (GPT 3.5 / 4, Anthropic, VertexAI) and RAG.


levanter

Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax


axolotl

Go ahead and axolotl questions


Here we provide and collect many functions to generate math problem and step by step solutions for LLM training


A proof-of-concept project that showcases the potential for using small, locally trainable LLMs to create next-generation documentation tools.


daggy

A directed acyclic graph data structure for Rust.


infinigen

Infinite Photorealistic Worlds using Procedural Generation


openpilot

openpilot is an open source driver assistance system. openpilot performs the functions of Automated Lane Centering and Adaptive Cruise Control for 250+ supported car makes and models.


xyflow

React Flow | Svelte Flow - Powerful open source libraries for building node-based UIs with React (https://reactflow.dev) or Svelte (https://svelteflow.dev). Ready out-of-the-box and infinitely customizable.


ml-hierarchical-confusion-matrix

Neo: Hierarchical Confusion Matrix Visualization (CHI 2022)


evaporate

This repo contains data and code for the paper "Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Data Lakes"


TART

TART: A plug-and-play Transformer module for task-agnostic reasoning


pyrender

Easy-to-use glTF 2.0-compliant OpenGL renderer for visualization of 3D scenes.


ane

Reverse engineered Linux driver for the Apple Neural Engine (ANE).


[CVPR 2023 Highlight]  Official implementation of "NeMo: 3D Neural Motion Fields from Multiple Video Instances of the Same Action"


Ebou

A cross platform Mastodon Client written in Rust


tapnet

Tracking Any Point (TAP)


sd-webui-controlnet-TemporalNet-API

WebUI extension for ControlNet


SNP

Official code for View Synthesis with Sculpted Neural Points


Fast-Racing

An Open-source Strong Baseline for SE(3) Planning in Autonomous Drone Racing


dreamsim

DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Data (NeurIPS 2023 Spotlight)


osqp

The Operator Splitting QP Solver


risk-sensitive-rl

Adaptive Risk Tendency Implicit Quantile Network for Drone Navigation under Partial Observability.


A training framework for Stable Baselines3 reinforcement learning agents, with hyperparameter optimization and pre-trained agents included.


ROS2 Navigation Framework and System


PX4 avoidance ROS node for obstacle detection and avoidance.


flightmare

An Open Flexible Quadrotor Simulator


AirSim-Drone-Racing-VAE-Imitation

Code associated with our paper "Learning Visuomotor Policies for Aerial Navigation Using Cross-Modal Representations": https://arxiv.org/abs/1909.06993


ijepa

Official codebase for I-JEPA, the Image-based Joint-Embedding Predictive Architecture. First outlined in the CVPR paper, "Self-supervised learning from images with a joint-embedding predictive architecture."


clip-guided-diffusion

CLIP Guided Diffusion


ecoute

Ecoute is a live transcription tool that provides real-time transcripts for both the user's microphone input (You) and the user's speakers output (Speaker) in a textbox. It also generates a suggested response using OpenAI's GPT-3.5 for the user to say based on the live transcription of the conversation.


HybrIK

Official code of "HybrIK: A Hybrid Analytical-Neural Inverse Kinematics Solution for 3D Human Pose and Shape Estimation", CVPR 2021


ViTMatte

[Information Fusion] Boosting Image Matting with Pretrained Plain Vision Transformers


pdm

A modern Python package and dependency manager supporting the latest PEP standards


Caption-Anything

Caption-Anything is a versatile tool combining image segmentation, visual captioning, and ChatGPT, generating tailored captions with diverse controls for user preferences. https://huggingface.co/spaces/TencentARC/Caption-Anything https://huggingface.co/spaces/VIPLab/Caption-Anything


[ CVPR 2023 Award Candidate ] OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generation


An extension of Open3D to address 3D Machine Learning tasks


Open3D: A Modern Library for 3D Data Processing


camtools

CamTools: Camera Tools for Computer Vision


security-constraints

Fetches security vulnerabilities and creates pip-constraints based on them.


tmf

Tight Model format is an experimental lossy 3D model format focused on reducing file size as much as posible without decreasing visual quality of the viewed model or read speeds.


pyston

A faster and highly-compatible implementation of the Python programming language.


chainlit

Build Conversational AI in minutes ⚡


FasterViT

[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention


Matting-Anything

Matting Anything Model (MAM), an efficient and versatile framework for estimating the alpha matte of any instance in an image with flexible and interactive visual or linguistic user prompt guidance.


aseprite

Animated sprite editor & pixel art tool (Windows, macOS, Linux)


SA-HMR

Code for "Learning Human Mesh Recovery in 3D Scenes" CVPR 2023


seewav

Audio waveform visualisation, converts any audio to a nice video


H2-Mapping: Real-time Dense Mapping Using Hierarchical Hybrid Representation (RAL 2023)


aero

This repo contains the official PyTorch implementation of "Audio Super Resolution in the Spectral Domain" (ICASSP 2023)


LLaMPPL

A domain-specific probabilistic programming language for modeling and inference with language models


IronDepth

(BMVC 2022) IronDepth: Iterative Refinement of Single-View Depth using Surface Normal and its Uncertainty


music-rearranger

Rearrange a music recording to match a new duration - Code for "Music Rearrangement Using Hierarchical Segmentation", ICASSP 2023


NKSR

[CVPR 2023 Highlight] Neural Kernel Surface Reconstruction


SegmentAnyRGBD

Segment Any RGBD


Otter

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.


ShadowNeuS

ShadowNeuS: Neural SDF Reconstruction by Shadow Ray Supervision (CVPR 2023)


audiocraft

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.


qax

If it quacks like a tensor...


shapy

CVPR 2022 - Official code repository for the paper: Accurate 3D Body Shape Regression using Metric and Semantic Attributes.


LEARNING LATENT PERMUTATIONS WITH GUMBEL-SINKHORN NETWORKS IMPLEMENTATION WITH PYTORCH


permute-quantize-finetune

Using ideas from product quantization for state-of-the-art neural network compression.


SimpleDreamer

A Simplified Pytorch Version of the Dreamer Algorithm


qrbtf

An art QR code (qrcode) beautifier.  艺术二维码生成器。https://qrbtf.com


boson-graphics

Just use daxa. Rust support is in active development, as I am a maintainer of the Rust API! https://github.com/ipotrick/daxa https://github.com/ipotrick/daxa-rs


simpleaichat

Python package for easily interfacing with chat apps, with robust features and minimal code complexity.


PufferLib

Simplifying reinforcement learning for complex game environments


multires-conv

Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)


recognize-anything

Open-source and strong foundation image recognition models.


ELICIT

[ICCV 2023] One-shot Implicit Animatable Avatars with Model-based Priors


pixel-perfect-sfm

Pixel-Perfect Structure-from-Motion with Featuremetric Refinement (ICCV 2021, Best Student Paper Award)


stableGAN

The code for the ICLR 2018 paper "Stabilizing Adversarial Nets With Prediction Methods"


DynamicVectorQuantization

Official Pytorch Implementation of Our CVPR2023 Paper: "Towards Accurate Image Coding: Improved Autoregressive Image Generation with Dynamic Vector Quantization"


pygwalker

PyGWalker: Turn your pandas dataframe into an interactive UI for visual analysis


graphic-walker

An open source alternative to Tableau. Easily embedded in any web apps.


nerfvis

NeRF visualization library under construction


llm-hosting-container

Large Language Model Hosting Container


awesome-langchain

😎 Awesome list of tools and projects with the awesome LangChain framework


ReWOO

Decoupling Reasoning from Observations for Efficient Augmented Language Models


TransformerPrograms

[NeurIPS 2023] Learning Transformer Programs


mica-MovieCLIP

This repository contains the codebase for MovieCLIP: Visual Scene Recognition in Movies


SelFee

Official codebase for "SelFee: Iterative Self-Revising LLM Empowered by Self-Feedback Generation"


Video-LLaMA

[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding


MedSAM

Segment Anything in Medical Images


dlib

A toolkit for making real world machine learning and data analysis applications in C++


NeRF-NCNN

NeRF in NCNN with c++ & vulkan


DreamBerd

perfect programming language


DragGAN meets GET3D for interactive mesh generation and editing.


DeepFake-Adapter

Code for DeepFake-Adapter: Dual-Level Adapter for DeepFake Detection


BIMT

Brain-Inspired Modular Training (BIMT), a method for making neural networks more modular and interpretable.


nanocl

Distributed System that simplifies the management of containers and virtual machines.


abseil-py

Abseil Common Libraries (Python)


wikidata

Wikidata client library for Python


document-automation

Document Automation Reference Kit


localGPT

Chat with your documents on your local device using GPT models. No data leaves your device and 100% private.


leocad

A CAD application for creating virtual LEGO models


plane

🔥 🔥 🔥 Open Source JIRA, Linear and Asana Alternative. Plane helps you track your issues, epics, and product roadmaps in the simplest way possible.


GlyphControl-release

[NeurIPS2023] This is the official code of the paper "GlyphControl: Glyph Conditional Control for Visual Text Generation"


llm-awq

AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration


Neural transient field for non-line-of-sight imaging


Conceptor

Official implementation of the paper The Hidden Language of Diffusion Models


Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".


SillyTavern

LLM Frontend for Power Users.


[CVPR 2023] VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking


coremltools

Core ML tools contain supporting tools for Core ML model conversion, editing, and validation.


CelebBasis

Official Implementation of 'Inserting Anybody in Diffusion Models via Celeb Basis'


AI based all-in-one character generator Blender plug-in. This project contains unofficial updates for the CEB_ECON Blender add-on.


dataclasses-json

Easily serialize Data Classes to and from JSON


hiera

Hiera: A fast, powerful, and simple hierarchical vision transformer.


XVFI

Official repository of XVFI (ICCV 2021, Oral)


Industrial knn-based anomaly detection for images. Visit streamlit link to check out the demo.


can-ai-code

Self-evaluating interview for AI coders


knn-vc

Voice Conversion With Just Nearest Neighbors


MeshUDF

Fast and Differentiable Meshing of Unsigned Distance Field Networks


Macaw-LLM

Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration


exllama

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.


wordcab-transcribe

💬 ASR FastAPI server using faster-whisper and Multi-Scale Auto-Tuning Spectral Clustering for diarization.


Make-Your-Video

[IEEE TVCG 2024] Customized Video Generation Using Textual and Structural Guidance


length-generalization

Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023


Modified Stanford-Alpaca Trainer for Training Replit's Code Model


nvblox

A GPU-accelerated TSDF and ESDF library for robots equipped with RGB-D cameras.


llama-dfdx

LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!


paradigms

PyTorch implementation for "Parallel Sampling of Diffusion Models", NeurIPS 2023 Spotlight


Gen-L-Video

The official implementation for "Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoising".


ddpo

Code for the paper "Training Diffusion Models with Reinforcement Learning"


nvtop

GPUs process monitoring for AMD, Intel and NVIDIA


FFCV-SSL

FFCV-SSL Fast Forward Computer Vision for Self-Supervised Learning.


SillyTavern

LLM Frontend for Power Users.


[CVPR 2023] VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking


coremltools

Core ML tools contain supporting tools for Core ML model conversion, editing, and validation.


CelebBasis

Official Implementation of 'Inserting Anybody in Diffusion Models via Celeb Basis'


AI based all-in-one character generator Blender plug-in. This project contains unofficial updates for the CEB_ECON Blender add-on.


dataclasses-json

Easily serialize Data Classes to and from JSON


hiera

Hiera: A fast, powerful, and simple hierarchical vision transformer.


XVFI

Official repository of XVFI (ICCV 2021, Oral)


Industrial knn-based anomaly detection for images. Visit streamlit link to check out the demo.


can-ai-code

Self-evaluating interview for AI coders


knn-vc

Voice Conversion With Just Nearest Neighbors


MeshUDF

Fast and Differentiable Meshing of Unsigned Distance Field Networks


Macaw-LLM

Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration


exllama

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.


wordcab-transcribe

💬 ASR FastAPI server using faster-whisper and Multi-Scale Auto-Tuning Spectral Clustering for diarization.


Make-Your-Video

[IEEE TVCG 2024] Customized Video Generation Using Textual and Structural Guidance


length-generalization

Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023


Modified Stanford-Alpaca Trainer for Training Replit's Code Model


nvblox

A GPU-accelerated TSDF and ESDF library for robots equipped with RGB-D cameras.


llama-dfdx

LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!


paradigms

PyTorch implementation for "Parallel Sampling of Diffusion Models", NeurIPS 2023 Spotlight


Gen-L-Video

The official implementation for "Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoising".


ddpo

Code for the paper "Training Diffusion Models with Reinforcement Learning"


nvtop

GPUs process monitoring for AMD, Intel and NVIDIA


FFCV-SSL

FFCV-SSL Fast Forward Computer Vision for Self-Supervised Learning.


pgvector

Open-source vector similarity search for Postgres


prompt-engineering

Tips and tricks for working with Large Language Models like OpenAI's GPT-4.


DejaVu

Repository for the paper Do SSL Models Have Déjà Vu? A Case of Unintended Memorization in Self-supervised Learning


deepscatter

Zoomable, animated scatterplots in the browser that scales over a billion points


mmt

Official Implementation of "Multitrack Music Transformer" (ICASSP 2023)


TaleCrafter

[SIGGRAPH Asia 2023] An interactive story visualization tool that support multiple characters


Source code for "Modulation Extraction for LFO-driven Audio Effects".


TSDNet

This is the python code corresponding to the article "Deep Network-Enabled Haze Visibility Enhancement for Visual IoT-Driven Intelligent Transportation Systems"


DawDreamer

Digital Audio Workstation with Python; VST instruments/effects, parameter automation, FAUST, JAX, Warp Markers, and JUCE processors


supercollider

An audio server, programming language, and IDE for sound synthesis and algorithmic composition.


flucoma-core

Core algorithms and objects for the Fluid Corpus Manipulation Library


Torch-Pruning

[CVPR 2023] Towards Any Structural Pruning; LLMs / SAM /  Diffusion / Transformers / YOLOv8 / CNNs


MeZO

[NeurIPS 2023] MeZO: Fine-Tuning Language Models with Just Forward Passes. https://arxiv.org/abs/2305.17333


Document-Plugin

Plug-and-Play Document Modules for Pre-trained Models


SDX23 startkit for the Demucs baselines.


mint

Multi-modal Content Creation Model Training Infrastructure including the FACT model (AI Choreographer) implementation.


BandSplitRNN-PyTorch

Unofficial PyTorch implementation of Music Source Separation with Band-split RNN


open-unmix-pytorch

Open-Unmix - Music Source Separation for PyTorch


LaVIN

[NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"


Knowledge-Plugin

Repo for ACL2023 paper "Plug-and-Play Knowledge Injection for Pre-trained Language Models"


Modularity-Analysis

Repo for ACL2023 Findings paper "Emergent Modularity in Pre-trained Transformers"


UniControl

Unified Controllable Visual Generation Model


roop

one-click face swap


PIRender

The source code of the ICCV2021 paper "PIRenderer: Controllable Portrait Image Generation via Semantic Neural Rendering"


Wuerstchen

Official implementation of Würstchen: Efficient Pretraining of Text-to-Image Models


worldsheet

Code release for the paper “Worldsheet Wrapping the World in a 3D Sheet for View Synthesis from a Single Image”, ICCV 2021.


mediamtx

Ready-to-use SRT / WebRTC / RTSP / RTMP / LL-HLS media server and media proxy that allows to read, publish, proxy, record and playback video and audio streams.


sd-webui-StableStudio

A custom extension for AUTOMATIC1111/stable-diffusion-webui to extend rest APIs to do some local operations, using in StableStudio.


Embedding Vector Visualization for Stable Diffusion web UI


sd-webui-cutoff

Cutoff - Cutting Off Prompt Effect


Mr.-Ranedeer-AI-Tutor

A GPT-4 AI Tutor Prompt for customizable personalized learning experiences.


NeTI

Official Implementation for "A Neural Space-Time Representation for Text-to-Image Personalization" (SIGGRAPH Asia 2023)


Unofficial implementation of DragGAN with StyleGAN2/3 pretrained models


gorilla

Gorilla: An API store for LLMs


spafe

:sound: spafe: Simplified Python Audio Features Extraction


essentia

C++ library for audio and music analysis, description and synthesis, including Python bindings


dotfiles

:wrench: .files, including ~/.macos — sensible hacker defaults for macOS


msgspec

A fast serialization and validation library, with builtin support for JSON, MessagePack, YAML, and TOML


aider

aider is AI pair programming in your terminal


NeRO

[SIGGRAPH2023] NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Images


pedalboard

🎛 🔊 A Python library for working with audio.


MT3: Multi-Task Multitrack Music Transcription


Beat-Transformer

Codes for ISMIR 2022 paper: Beat Transformer: Demixed Beat and Downbeat Tracking with Dilated Self-Attention


wavebeat

End-to-end beat and downbeat tracking in the time domain.


SpecTNT-pytorch

Unofficial implementation of SpecTNT in pytorch


BeatNet

BeatNet is state-of-the-art (Real-Time) and Offline joint music beat, downbeat, tempo, and meter tracking system using CRNN and particle filtering.  (ISMIR 2021's paper implementation).

Creative Commons Attribution 4.0 International


madmom

Python audio and music signal processing library


chain-of-thought-hub

Benchmarking large language models' complex reasoning ability with chain-of-thought prompting


taichi-nerfs

Implementations of NeRF variants based on Taichi + PyTorch


prolificdreamer

Official code of ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation (NeurIPS 2023 Spotlight)


NFD

Official codebase for the paper "3D Neural Field Generation using Triplane Diffusion"


Voyager

An Open-Ended Embodied Agent with Large Language Models


AudioToken

This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image Generation


embedbase

A dead-simple API to build LLM-powered apps


Prompt-Free-Diffusion

Prompt-Free Diffusion: Taking "Text" out of Text-to-Image Diffusion Models


NeuMesh

Code for "MeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editing", ECCV 2022 Oral


outlines

Structured Text Generation


vulkano

Safe and rich Rust wrapper around the Vulkan API


qlora

QLoRA: Efficient Finetuning of Quantized LLMs


magicmix

Unofficial Implementation of MagicMix


msaf

Music Structure Analysis Framework


music-text-representation

Toward Universal Text-to-Music-Retrieval (TTMR) [ICASSP23]


ace

[CVPR 2023 - Highlight] Accelerated Coordinate Encoding (ACE): Learning to Relocalize in Minutes using RGB and Poses


RAVE-Latent-Diffusion

Generate new latent codes for RAVE with Denoising Diffusion models.


ProFusion

Code for Enhancing Detail Preservation for Customized Text-to-Image Generation: A Regularization-Free Approach


Code for Improving Factuality and Reasoning in Language Models through Multiagent Debate


A simulation framework for RLHF and alternatives. Develop your RLHF method without collecting human data.


fondant

Production-ready data processing made easy and shareable


metrical-tracker

Metrical Monocular Photometric Tracker [ECCV2022]


INSTA

INSTA - Instant Volumetric Head Avatars [CVPR2023]


YouQ

Chrome Extension for YouTube. Acts as an assistant for the YouTube video you are watching


partitura

A python package for handling modern staff notation of music


This repository contains the implementation of an efficient joint beat, downbeat, tempo, and meter tracking system using a compact 1D probabilistic state space and a jump-back reward technique. ICASSP 2022.


RecurrentGPT

Official Code for Paper: RecurrentGPT: Interactive Generation of (Arbitrarily) Long Text


ott

Optimal Transport tools implemented with the JAX framework, to get auto-diff, parallel and jit-able computations.


Efficient-VDVAE

Official Pytorch and JAX implementation of "Efficient-VDVAE: Less is more"


imagebind-guided-diffusion

Guide diffusion on ImageBind embedding similarity


trogon

Easily turn your Click CLI into a powerful terminal application


inseq

Interpretability for sequence generation models 🐛 🔍


SceneRF

[ICCV 2023] Official implementation of "SceneRF: Self-Supervised Monocular 3D Scene Reconstruction with Radiance Fields"


pyserde

Yet another serialization library on top of dataclasses, inspired by serde-rs.


tree-of-thoughts

Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%


LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.


llama-dl

High-speed download of LLaMA, Facebook's 65B parameter GPT model


GT4SD, an open-source library to accelerate hypothesis generation in the scientific discovery process.


Source code of paper 'Aligning Instruction Tasks Unlocks Large Language Models as Zero-Shot Relation Extractors' (ACL 2023 Findings)


Co-SLAM

[CVPR'23] Co-SLAM: Joint Coordinate and Sparse Parametric Encodings for Neural Real-Time SLAM


FlowLens

PyTorch implementation of FlowLens (https://arxiv.org/pdf/2211.11293)


controlnetvideo

Apply controlnet to video clips


Export pytorch model to ONNX and convert ONNX from float32 to float 16


DragGAN

Unofficial Implementation of DragGAN - "Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold" （DragGAN 全功能实现，在线Demo，本地部署试用，代码、模型已全部开源，支持Windows, macOS, Linux）


WebUI extension for using Blip2


The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.


VCN

Volumetric Correspondence Networks for Optical Flow, NeurIPS 2019.


Code for Shifted Diffusion for Text-to-image Generation (CVPR 2023)


stochastic-bridge-pet

Code for ACL 2023 Findings paper "Stochastic Bridges as Effective Regularizers for Parameter-Efficient Tuning"


Lora-for-Diffusers

The most easy-to-understand tutorial for using LoRA (Low-Rank Adaptation) within diffusers framework for AI Generation Researchers🔥


ONE-PEACE

A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities


Scribble-to-Mask

[CVPR 2021] MiVOS - Scribble to Mask module


mpmath

Python library for arbitrary-precision floating-point arithmetic


FastDifferentiableMatSqrt

ICLR22 "Fast Differentiable Matrix Square Root" and T-PAMI extension


Image editor for the AUTOMATIC1111 stable-diffusion-webui


expansion

Upgrading Optical Flow to 3D Scene Flow through Optical Expansion, CVPR 2020 (Oral).


zep

Zep: Fast, scalable building blocks for production LLM apps


developer

the first library to let you embed a developer agent in your own app!


text-generation-webui

A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.


GenerativeModels

MONAI Generative Models makes it easy to train, evaluate, and deploy generative models and related applications


humanrf

Official code for "HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motion"


VisionLLM

VisionLLM: Large Language Model is also an Open-Ended Decoder for Vision-Centric Tasks


VLPart

[ICCV2023] VLPart: Going Denser with Open-Vocabulary Part Segmentation


git-aid

LLM powered functions to supercharge your GitHub workflow.


dacite

Simple creation of data classes from dictionaries.


UserControllableLT

PyTorch implementation of ``User-Controllable Latent Transformer for StyleGAN Image Layout Editing'' [Computer Graphics Forum (Proc. of Pacific Graphics 2022)]


sd-webui-civbrowser

Extension to search and download Civitai models in multiple tabs. Save model information. Send sample infotext to txt2img.


DragGAN

Official Code for DragGAN (SIGGRAPH 2023)


eindex

Multidimensional indexing for tensors


sd-webui-prompt-all-in-one

This is an extension based on sd-webui, aimed at improving the user experience of the prompt/negative prompt input box. It has a more intuitive and powerful input interface function, and provides automatic translation, history record, and bookmarking functions.    这是一个基于 sd-webui 的扩展，旨在提高提示词/反向提示词输入框的使用体验。它拥有更直观、强大的输入界面功能，它提供了自动翻译、历史记录和收藏等功能。


minChatGPT

A minimum example of aligning language models with RLHF similar to ChatGPT


fastcomposer

FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attention


BELLE

BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）


visualblocks

Visual Blocks for ML is a Google visual programming framework that lets you create ML pipelines in a no-code graph editor. You – and your users – can quickly prototype workflows by connecting drag-and-drop ML components, including models, user inputs, processors, and visualizations.


lancedb

Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!


deepops

Tools for building GPU clusters


LLMSurvey

The official GitHub page for the survey paper "A Survey of Large Language Models".


DCGM

NVIDIA Data Center GPU Manager (DCGM) is a project for gathering telemetry and measuring the health of NVIDIA GPUs


soundstorm-pytorch

Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch


scoring-without-correspondences

[CVPR 2023] Two-view Geometry Scoring Without Correspondences


OvercookedGPT

An OpenAI gym environment to evaluate the ability of LLMs (eg. GPT-4, Claude) in long-horizon reasoning and task planning in dynamic multi-agent settings.


StableStudio

Community interface for generative AI


ImageBind-LoRA

Fine-tuning "ImageBind One Embedding Space to Bind Them All" with LoRA


Gradient-Free-Textual-Inversion

Gradient-Free Textual Inversion for Personalized Text-to-Image Generation


easy-neural-ode

Code for the paper "Learning Differential Equations that are Easy to Solve"


Tiled Diffusion and VAE optimize, licensed under CC BY-NC-SA 4.0


polymath

Convert any music library into a music production sample-library with ML


stylusboard

Online whiteboard server for real-time collaboration in Write


ICML 2023: Reduce, Reuse, Recycle: Composing Energy-Based Diffusion Models with MCMC


FewGen

[ICML 2023] Tuning Language Models as Training Data Generators for Augmentation-Enhanced Few-Shot Learning


automatic

SD.Next: Advanced Implementation of Stable Diffusion and other Diffusion-based generative image models


SuperICL

Code for "Small Models are Valuable Plug-ins for Large Language Models"


Home of CodeT5: Open Code LLMs for Code Understanding and Generation


CLIPA

[NeurIPS 2023] This repository includes the official implementation of our paper "An Inverse Scaling Law for CLIP Training"


Make-A-Protagonist

Make-A-Protagonist: Generic Video Editing with An Ensemble of Experts


dynibar

Implementation of DynIBaR Neural Dynamic Image-Based Rendering (CVPR 2023)


Pointcept

Pointcept: a codebase for point cloud perception research. Latest works: PTv3, PPT, MSC, PTv2


SAM3D: Segment Anything in 3D Scenes


sketch + style = paints :art: (TOG2018/SIGGRAPH2018ASIA)


node

Neural Oblivious Decision Ensembles for Deep Learning on Tabular Data


White-box-Cartoonization

Official tensorflow implementation for CVPR2020 paper “Learning to Cartoonize Using White-box Cartoon Representations”


pytorch-cnn-visualizations

Pytorch implementation of convolutional neural network visualization techniques


A sketch extractor for anime/illustration.


Fast-Transformer

An implementation of Fastformer: Additive Attention Can Be All You Need, a Transformer Variant in TensorFlow


BIG-bench

Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models


basic-pitch

A lightweight yet powerful audio-to-MIDI converter with pitch bend detection


MineDojo

Building Open-Ended Embodied Agents with Internet-Scale Knowledge


FTVSR

[ECCV'22] FTVSR: Learning Spatiotemporal Frequency-Transformer for Compressed Video Super-Resolution


MM-Diffusion

[CVPR'23] MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation


recurrent-interface-network-pytorch

Implementation of Recurrent Interface Network (RIN), for highly efficient generation of images and video without cascading networks, in Pytorch


Implementation of Hinton's forward-forward (FF) algorithm - an alternative to back-propagation


MultiDiffusion

Official Pytorch Implementation for "MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generation" presenting "MultiDiffusion" (ICML 2023)


mixture-of-diffusers

Mixture of Diffusers for scene composition and high resolution image generation


guidance

A guidance language for controlling large language models.


PASSL

PASSL包含 SimCLR，MoCo v1/v2，BYOL，CLIP，PixPro，simsiam, SwAV, BEiT，MAE   等图像自监督算法以及 Vision Transformer，DEiT，Swin Transformer，CvT，T2T-ViT，MLP-Mixer，XCiT，ConvNeXt，PVTv2 等基础视觉算法


react-llm

Easy-to-use headless React Hooks to run LLMs in the browser with WebGPU. Just useLLM().


fasten-onprem

Fasten is an open-source, self-hosted, personal/family electronic medical record aggregator, designed to integrate with 100,000's of insurances/hospitals/clinics


DifferentiableSVD

A collection of differentiable SVD methods and ICCV21 "Why Approximate Matrix Square Root Outperforms Accurate SVD in Global Covariance Pooling?"


zeus-llm-trainer

Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models


biogpt.cpp

Port of Microsoft's BioGPT in C/C++ using ggml


ctransformers

Python bindings for the Transformer models implemented in C/C++ using GGML library.


PaLM

An open-source implementation of Google's PaLM models


smartgpt

A program that provides LLMs with the ability to complete complex tasks using plugins.


starcoder.cpp

C++ implementation for 💫StarCoder


PaddleFleetX

飞桨大模型开发套件，提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。


deepchem

Democratizing Deep-Learning for Drug Discovery, Quantum Chemistry, Materials Science and Biology


PyTorch Extension Library of Optimized Autograd Sparse Matrix Operations


crossbeam

Tools for concurrent programming in Rust


binary-latent-diffusion

Implementation of Binary Latent Diffusion


voila-vuetify

Dashboard template for Voilà based on VuetifyJS


solara

A Pure Python, React-style Framework for Scaling Your Jupyter and Web Apps


faer-rs

Linear algebra foundation for the Rust programming language


obs-backgroundremoval

An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.


matrixmultiply

General matrix multiplication of f32 and f64 matrices in Rust. Supports matrices with general strides.


onthespot

qt based music downloader written in python


dreamfusionacc

A PyTorch implementation of text-to-3D models, e.g., DreamFusion and Magic3D, based on NerfAcc


cassowary

Run Windows Applications on Linux as if they are native, Use linux applications to launch files files located in windows vm without needing to install applications on vm. With easy to use configuration GUI


mvp

Training and Evaluation Code for "Mixture of Volumetric Primitives for Efficient Neural Rendering"


BlenderProc

A procedural Blender pipeline for photorealistic training image generation


whisper-stream

Thin wrapper around OpenAI Whisper API with streaming support


StableSR

Exploiting Diffusion Prior for Real-World Image Super-Resolution


asteroid

The PyTorch-based audio source separation toolkit for researchers


implicit-depth

[CVPR 2023] Virtual Occlusions Through Implicit Depth


AudioDec

An Open-source Streaming High-fidelity Neural Audio Codec


TopoModelX

Topological Deep Learning


wordcraft

✨✍ Wordcraft is an AI-powered text editor with an emphasis on short story writing


ChatPaper

Use ChatGPT to summarize the arXiv papers. 全流程加速科研，利用chatgpt进行论文全文总结+专业翻译+润色+审稿+审稿回复


refactor

AST-based fragmental source code refactoring toolkit for Python


glue

Linked Data Visualizations Across Multiple Files


RenderMe-360: Large Digital Asset Library and Benchmark Towards High-fidelity Head Avatars


generative.monster

A fully autonomous AI artist


blendify

Lightweight Python framework that provides a high-level API for creating and rendering scenes with Blender.


LLM-Document-Chat

Using LlamaIndex, Redis, and OpenAI to chat with PDF documents. Supplementary material for blog post on Microsoft Developer Blog


redis-arXiv-search

Vector search demo with the arXiv paper dataset, RedisVL, HuggingFace, OpenAI, Cohere, FastAPI, React, and Redis.


sru

Training RNNs as Fast as CNNs (https://arxiv.org/abs/1709.02755)


edge-connect

EdgeConnect: Structure Guided Image Inpainting using Edge Prediction, ICCV  2019 https://arxiv.org/abs/1901.00212


DiffusionDet

[ICCV2023 Oral] PyTorch implementation of DiffusionDet (https://arxiv.org/abs/2211.09788)


arxiv-utils

Meaningful titles for tabs and PDF downloads! Also supports tab search.


arxiv.py

Python wrapper for the arXiv API


Convert ONNX models to PyTorch.


ZipIt

A framework for merging models solving different tasks with different initializations into one multi-task model without any additional training


pytriton

PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.


consistency-models

A Toolkit for OpenAI's Consistency Models.


lit-gpt

Hackable implementation of state-of-the-art open-source LLMs based on nanoGPT. Supports flash attention, 4-bit and 8-bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.


opencv-mobile

The minimal opencv for Android, iOS, ARM Linux, Windows, Linux, MacOS, WebAssembly


mlc-llm

Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.


Auto-GPT-Plugins

Plugins for Auto-GPT


NeMo-Guardrails

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.


YouTokenToMe

Unsupervised text tokenizer focused on computational efficiency


atuin

✨ Magical shell history


Radarr

Movie organizer/manager for usenet and torrent users.


blocky

Fast and lightweight DNS proxy as ad-blocker for local network with many features


butterfish

A shell with AI superpowers


Clipboard

😎🏖🐬 Your new, 𝙧𝙞𝙙𝙤𝙣𝙠𝙪𝙡𝙞𝙘𝙞𝙤𝙪𝙨𝙡𝙮 smart clipboard manager


watchman

Watches files and records, or triggers actions, when they change.


gum

A tool for glamorous shell scripts 🎀


A command-line productivity tool powered by AI large language models like GPT-4, will help you accomplish your tasks faster and more efficiently.


swww

A Solution to your Wayland Wallpaper Woes


openlm

OpenAI-compatible Python client that can call any LLM


nope-nerf

(CVPR 2023) NoPe-NeRF: Optimising Neural Radiance Field with No Pose Prior


ms-nerf

Multi-Space Neural Radiance Fields(CVPR 2023)


LLMsPracticalGuide

A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)


Dromedary

Dromedary: towards helpful, ethical and reliable LLMs.


ImageBind

ImageBind One Embedding Space to Bind Them All


PyTorch Extension Library of Optimized Graph Cluster Algorithms


xla

Enabling PyTorch on XLA Devices (e.g. Google TPU)


isort

A Python utility / library to sort imports.


ndarray

ndarray: an N-dimensional array with array views, multidimensional slicing, and efficient operations


ganbreeder

Breed and share images using biggan


OTK

A Pytorch implementation of the optimal transport kernel embedding


open-gpu-kernel-modules

NVIDIA Linux open GPU kernel module source


deep-rl-class

This repo contains the syllabus of the Hugging Face Deep Reinforcement Learning Course.


t-zero

Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)


seqio

Task-based datasets, preprocessing, and evaluation for sequence models.


An open-source platform for Visual AI.


PyTorch version of Stable Baselines, reliable implementations of reinforcement learning algorithms.


An Open Source package that allows video game creators, AI researchers and hobbyists the opportunity to learn complex behaviors for their Non Player Characters or agents


bigscience

Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.


We perform functional grounding of LLMs' knowledge in BabyAI-Text


lamorel

Lamorel is a Python library designed for RL practitioners eager to use Large Language Models (LLMs).


Parallel S3 and local filesystem execution tool.


multinerf

A Code Release for Mip-NeRF 360, Ref-NeRF, and RawNeRF


kopia

Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.


Multimodal-GPT

Multimodal-GPT


DVSR

DVSR ("Consistent Direct Time-of-Flight Video Depth Super-Resolution"), CVPR 2023


wn

A modern, interlingual wordnet interface for Python


santacoder-finetuning

Fine-tune SantaCoder for Code/Text Generation.


qlib

Qlib is an AI-oriented quantitative investment platform that aims to realize the potential, empower research, and create value using AI technologies in quantitative investment, from exploring ideas to implementing productions. Qlib supports diverse machine learning modeling paradigms. including supervised learning, market dynamics modeling, and RL.


threestudio

A unified framework for 3D content generation.


SD-CN-Animation

This script allows to automate video stylization task using StableDiffusion and ControlNet.


laserbeak

Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU


libvits-ncnn

libvits-ncnn is an ncnn implementation of the VITS library that enables cross-platform GPU-accelerated speech synthesis.🎙💻


IF-DreamFusion

DeepFloyd-IF-powered implementation of DreamFusion


OpenOccupancy

[ICCV 2023] OpenOccupancy: A Large Scale Benchmark for Surrounding Semantic Occupancy Perception


WebGPU-Cpp

A single-file zero-overhead C++ idiomatic wrapper for WebGPU native


reptyr

Reparent a running program to a new terminal


InfiNet

Implementation of DiffusionOverDiffusion architecture presented in NUWA-XL in a form of ControlNet-like module on top of ModelScope text2video model for extremely long video generation.


dont-stop-pretraining

Code associated with the Don't Stop Pretraining ACL 2020 paper


LoRA

Implementation of LoRA (Low-Rank Adaptation of Large Language Models) for GPT-J and GPT-2


unlimiformer

Public repo for the NeurIPS 2023 paper "Unlimiformer: Long-Range Transformers with Unlimited Length Input"


Better Aligning Text-to-Image Models with Human Preference. ICCV 2023


test

Measuring Massive Multitask Language Understanding | ICLR 2021


⚡Optimizing einsum functions in NumPy, Tensorflow, Dask, and more with contraction order optimization.


jellyfin

The Free Software Media System


GPU-Passthrough-Manager

GPU passthrough made easy.


llm-foundry

LLM training code for MosaicML foundation models


starcoder

Home of StarCoder: fine-tuning & inference!


DiffusionDepth

PyTorch Implementation of introducing diffusion approach to 3D depth perception


DeepMDMA

Hallucinations of a neural network set to music


rq

Simple job queues for Python


shap-e

Generate 3D objects conditioned on text or images


PySR

High-Performance Symbolic Regression in Python and Julia


diffusion-models-class

Materials for the Hugging Face Diffusion Models Course


Personalize-SAM

Personalize Segment Anything Model (SAM) with 1 shot in 10 seconds


Total-Recon

[ICCV 2023] Total-Recon: Deformable Scene Reconstruction for Embodied View Synthesis


[ICCV 2023] Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior


datacomp

DataComp: In search of the next generation of multimodal datasets


diffusion-rig

Code Release for DiffusionRig (CVPR 2023)


Prompt-Diffusion

Official PyTorch implementation of the paper "In-Context Learning Unlocked for Diffusion Models"


llm-vscode

LLM powered development for VSCode


webtorrent

⚡ Streaming torrent client for the web


liquid

Liquid markup language. Safe, customer facing template language for flexible web apps.


tabler

Tabler is free and open-source HTML Dashboard UI Kit built on Bootstrap


what-happens-when

An attempt to answer the age old interview question "What happens when you type google.com into your browser and press enter?"


ripgrep

ripgrep recursively searches directories for a regex pattern while respecting your gitignore


huginn

Create agents that monitor and act on your behalf.  Your agents are standing by!


git-flight-rules

Flight rules for git

Creative Commons Attribution Share Alike 4.0 International


localstack

💻 A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline


syncthing

Open Source Continuous File Synchronization


hoppscotch

👽 Open source API development ecosystem - https://hoppscotch.io


echarts

Apache ECharts is a powerful, interactive charting and data visualization library for browser


pyxel

A retro game engine for Python


MarkEdit

Just like TextEdit on Mac but dedicated to Markdown.


boxxy

boxxy puts bad Linux applications in a box with only their files.


ucall

Remote Procedure Calls  - 50x lower latency and 70x higher bandwidth than FastAPI, implementing JSON-RPC & 🔜 REST over io_uring and SIMDJSON ☎


hocus

🪄 Spin up ready-to-code, disposable dev environments on your own servers. Self-hosted alternative to Gitpod and Github Codespaces.


fleek

Own your $HOME


pterm

✨ #PTerm is a modern Go module to easily beautify console output. Featuring charts, progressbars, tables, trees, text input, select menus and much more 🚀 It's completely configurable and 100% cross-platform compatible.


croc

Easily and securely send things from one computer to another :crocodile: :package:


docsify

🃏 A magical documentation site generator.


modern-unix

A collection of modern/faster/saner alternatives to common unix commands.


ngrok

Introspected tunnels to localhost


algo

Set up a personal VPN in the cloud


sentry

Developer-first error tracking and performance monitoring


supabase

The open source Firebase alternative.


graphblas-algorithms

Graph algorithms written in GraphBLAS


frogmouth

A Markdown browser for your terminal


thinkgpt

Agent techniques to augment your LLM and push it beyong its limits


OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset


cl-vs-mim

(ICLR 2023) Official PyTorch implementation of "What Do Self-Supervised Vision Transformers Learn?"


VPGTrans

Codes for VPGTrans: Transfer Visual Prompt Generator across LLMs. VL-LLaMA, VL-Vicuna.


awesome-instruction-dataset

A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)


RWKV-CUDA

The CUDA version of the RWKV language model ( https://github.com/BlinkDL/RWKV-LM )


lorax

LoRA for arbitrary JAX models and functions


mojo

The Mojo Programming Language


BLIP2 captioning tool as an extension of AUTOMATIC's WebUI


memit

Mass-editing thousands of facts into a transformer memory (ICLR 2023)


my-spaces

Run hugging face spaces locally with one command!


ultralytics

NEW - YOLOv8 🚀 in PyTorch > ONNX > OpenVINO > CoreML > TFLite


adetailer

Auto detecting, masking and inpainting with detection model.


BabyAGI to run with GPT4All


LM-reasoning

This repository contains a collection of papers and resources on Reasoning in Large Language Models.


jsonformer

A Bulletproof Way to Generate Structured JSON from Language Models


sparsegpt

Code for the ICML 2023 paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot".


buf

The best way of working with Protocol Buffers.


Fast! Offline, privacy-focused, hands-free voice typing, 2-way AI voice chat, with images, voice control, in under 4 GiB of VRAM.


State-of-the-art voice typing in Linux terminal (or WFL sesson on Windows.) with a simple bash script. Works with X. Does not require X.


airunner

Stable Diffusion and LLMs offline on your own hardware


AI-Horde

A crowdsourced distributed cluster for AI art and text generation


C implementation of GPT2 token codec


GPT2 Byte Pair Encoding implementation in Golang


novelai-tokenizer

Sentencepiece based BPE tokenizer for English and Japanese language text.


UnpromptedControl

Remove unwanted objects and restore images without prompts, powered by ControlNet.


LaMini-LM

LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions


Holodeck

🎮👥 Experience the future of multiplayer gaming with MUDGPT's AI-generated virtual world! 🌟🤖


GPTWorld

A puzzle to learn about prompting


WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath


rye

a Hassle-Free Python Experience


MeshDiffusion

Official implementation of "MeshDiffusion: Score-based Generative 3D Mesh Modeling" (ICLR 2023 Spotlight)


Perp-Neg-stablediffusion

source code for Stable Diffusion with Perp-Neg


promptimize

Promptimize is a prompt engineering evaluation and testing toolkit.


ReinMax

Beyond Straight-Through


wave

Realtime Web Apps and Dashboards for Python and R


RelateAnything

Relate Anything Model is capable of taking an image as input and utilizing SAM to identify the corresponding mask within the image.


Track-Anything

Track-Anything is a flexible and interactive tool for video object tracking and segmentation, based on Segment Anything, XMem, and E2FGVI.


omnidata

A Scalable Pipeline for Making Steerable Multi-Task Mid-Level Vision Datasets from 3D Scans [ICCV 2021]


TopoEmbedX

Representation Learning on Topological Domains


sagemaker-ssh-helper

A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)


TopoNetX

Computing on Topological Domains


finetune-sd

what I learned about fine-tuning stable diffusion


dataless-model-merging

Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)


recurrent-memory-transformer-pytorch

Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch


tree-sitter

An incremental parsing system for programming tools


qdrant

Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/


tantivy

Tantivy is a full-text search engine library inspired by Apache Lucene and written in Rust


pystack

🔍 🐍 Like pstack but for Python!


ipydatagrid

Fast Datagrid widget for the Jupyter Notebook and JupyterLab


SocialAGI

Cognitive Functions for AI Souls


internet-explorer

Internet Explorer explores the web in a self-supervised manner to progressively find relevant examples that improve performance on a desired target dataset.


whisper-jax

JAX implementation of OpenAI's Whisper model for up to 70x speed-up on TPU.


pfgmpp

Code for ICML 2023 paper, "PFGM++: Unlocking the Potential of Physics-Inspired Generative Models"


[NeurIPS 2023] Official implementation of the paper "Segment Everything Everywhere All at Once"


Official implementation of "Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generation"


diart

A python package to build AI-powered real-time audio applications


Speech recognition module for Python, supporting several engines and APIs, online and offline.


Fast neural radiance field training with free camera trajectories


Segment-Anything + 3D. Let's lift anything to 3D.


Segment-and-Track-Anything

An open-source project dedicated to tracking and segmenting any objects in videos, either automatically or interactively. The primary algorithms utilized include the Segment Anything Model (SAM) for key-frame segmentation and Associating Objects with Transformers (AOT) for efficient tracking and propagation purposes.


Paint-by-Sketch

Stable Diffusion-based image manipulation method with a sketch and reference image


nerfbusters

Nerfbusters project


wasm-gpt

Tensor library for machine learning


MCC

Multiview Compressive Coding for 3D Reconstruction


WebGPT

Run GPT model on the browser with WebGPU. An implementation of GPT inference in less than ~1500 lines of vanilla Javascript.


roma

RoMa: A lightweight library to deal with 3D rotations in PyTorch.


NoisyTwins

[CVPR 2023] Source code for NoisyTwins: Class-consistent and Diverse Image Generation Through StyleGANs


Transcribe a live audio-stream in near real time using OpenAI-Whisper. Monitor it for keywords and trigger alarm to Signal messenger


whispering

Whispering Tiger - OpenAI's whisper with OSC and Websocket support. Allowing live transcription / translation in VRChat and Overlays in most Streaming Applications


gptrpg

A demo of an GPT-based agent existing in an RPG-like environment


stable-diffusion-webui-ux

Stable Diffusion web UI UX


picaisso

🎨 Imagine what Picasso could have done with AI. Self-host your StableDiffusion API.


LLMZoo

⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡


python-redis-cache

Simple redis cache for Python functions


aiosqlite

asyncio bridge to the standard sqlite3 module


aioduckdb

asyncio bridge to the duckdb library


chatgpt-cli

Streaming chatgpt cli with memory.


large-scale-lm-tutorials

Large-scale language modeling tutorials with PyTorch


bgpbt

[AutoML'22] Bayesian Generational Population-based Training (BG-PBT)


Repository for the ACL2023 paper "Reasoning with Language Model Prompting: A Survey".


LLaMA-Cult-and-More

Large Language Models for All, 🦙 Cult and More, Stay in touch !


awesome-adapter-resources

Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning


OCR-SAM

Combining MMOCR with Segment Anything & Stable Diffusion. Automatically detect, recognize and segment text instances, with serval downstream tasks, e.g., Text Removal and Text Inpainting


A UI made in Pyside6 to make training LoRA/LoCon and other LoRA type models in sd-scripts easy


epig

Prediction-oriented Bayesian active learning (AISTATS 2023)


oobleck

open soundstream-ish VAE codecs for downstream neural audio synthesis


compress-gpt

Self-extracting GPT prompts for ~70% token savings


txtinstruct

📚 Datasets and models for instruction-tuning


MicroAST

Official Pytorch code for "MicroAST: Towards Super-Fast Ultra-Resolution Arbitrary Style Transfer" (AAAI 2023)


chameleon-llm

Codes for "Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models".


UniverSeg

UniverSeg: Universal Medical Image Segmentation


bark

🔊 Text-Prompted Generative Audio Model


X-Decoder

[CVPR 2023] Official Implementation of X-Decoder for generalized decoding for pixel, image and language


CLIP Surgery for Better Explainability with Enhancement in Open-Vocabulary Tasks


SOLIDER

A Semantic Controllable Self-Supervised Learning Framework to learn general human representations from massive unlabeled human images, which can benefit downstream human-centric tasks to the maximum extent


silk

SiLK (Simple Learned Keypoint) is a self-supervised deep learning keypoint model.


autobound

AutoBound automatically computes upper and lower bounds on functions.


FlagAI

FlagAI (Fast LArge-scale General AI models) is a fast, easy-to-use and extensible toolkit for large-scale model.


YUCIHighPassSkinSmoothing

An implementation of High Pass Skin Smoothing using Apple's Core Image Framework


latent-nerf

Official Implementation for "Latent-NeRF for Shape-Guided Generation of 3D Shapes and Textures"


Gymnasium

An API standard for single-agent reinforcement learning environments, with popular reference environments and related utilities (formerly Gym)


LlamaAcademy

A school for camelids


StableLM

StableLM: Stability AI Language Models


pips

Particle Video Revisited


selfcheckgpt

SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models


rclone

"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files


maxtext

A simple, performant and scalable Jax LLM!


gisting

Learning to Compress Prompts with Gist Tokens - https://arxiv.org/abs/2304.08467


Multi-GPT

An experimental open-source attempt to make GPT-4 fully autonomous.


tiktoken-go

go version of tiktoken


AIUI

AIUI is a platform enabling seamless two-way verbal communication with AI.


jee-pee-tee

An Alexa Skill to interface with chat.openai.com


llm-chain

`llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks


chatgpt-memory

Allows to scale the ChatGPT API to multiple simultaneous sessions with infinite contextual and adaptive memory powered by GPT and Redis datastore.


EasyInstruct

An Easy-to-use Instruction Processing Framework for LLMs.


cataclysm

Cataclysm - Code generation library for the end game


llama.go

llama.go is like llama.cpp in pure Golang!


promptr

Promptr is a CLI tool that lets you use plain English to instruct GPT3 or GPT4 to make changes to your codebase.


Run LLaMA (and Stanford-Alpaca) inference on Apple Silicon GPUs.


YouTube Summary with ChatGPT is a simple Chrome Extension (manifest v3) that allows you to get both YouTube video transcripts and summary of the video with OpenAI's ChatGPT AI technology.


chatgpt-action

Let ChatGPT review PRs for you


prompt-in-context-learning

Awesome resources for in-context learning and prompt engineering: Mastery of the LLMs such as ChatGPT, GPT-3, and FlanT5, with up-to-date and cutting-edge updates.


GPTCache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.


PyTorch code and models for the DINOv2 self-supervised learning method.


storchastic

Stochastic Automatic Differentiation library for PyTorch.


ChatGPT-CodeReview

🐥 A code review bot powered by ChatGPT


chatblade

A CLI Swiss Army Knife for ChatGPT


LMFlow

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.


Pake

🤱🏻 Turn any webpage into a desktop app with Rust.  🤱🏻 利用 Rust 轻松构建轻量级多端桌面应用


nvitop

An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.


youtube-transcript-api

This is a python API which allows you to get the transcript/subtitles for a given YouTube video. It also works for automatically generated subtitles and it does not require an API key nor a headless browser, like other selenium based solutions do!


semantic-kernel

Integrate cutting-edge LLM technology quickly and easily into your apps


darwin-gpt

A minimal self-replicating agent based on GPT-3.5/4


Marching-Primitives

[CVPR2023 Highlight] Marching-Primitives: Shape Abstraction from Signed Distance Function


Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)


glasbey

Algorithmically create or extend categorical colour palettes


Inpaint-Anything

Inpaint anything using Segment Anything and inpainting models.


autodoc

Experimental toolkit for auto-generating codebase documentation using LLMs


cursor

An AI-powered code editor based on VSCode 🤖


notebooks

code for deep learning courses


Growing collection of scripts to summarize the scientific literature using large-language models like ChatGPT.


ai-brainstore

A proof-of-concept of a brain for an AI agent.


OneStepBabyAGI

Baby AGI is cool, but why write so much code when it could just be a single GPT4 call?


hyperDB

A hyper-fast local vector database for use with LLM Agents. Now accepting SAFEs at $135M cap.


web-llm

Bringing large-language models and chat to web browsers. Everything runs inside the browser with no server support.


pywb

Core Python Web Archiving Toolkit for replay and recording of web archives


xbmc

Kodi is an award-winning free and open source home theater/media center software and entertainment hub for digital media. With its beautiful interface and powerful skinning engine, it's available for Android, BSD, Linux, macOS, iOS, tvOS and Windows.


DocsGPT

GPT-powered chat for documentation, chat with your documents


compel

A prompting enhancement library for transformers-type text embedding systems


CodeGeeX

CodeGeeX: An Open Multilingual Code Generation Model (KDD 2023)


An unofficial reproduction of Fantasia3D


ImageReward

[NeurIPS 2023] ImageReward: Learning and Evaluating Human Preferences for Text-to-image Generation


open-muse

Open reproduction of MUSE for fast text2image generation.


MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.


agd

Automatic gradient descent


MLPruning

MLPruning, PyTorch, NLP, BERT, Structured Pruning


council-of-ai

Security measure for agentic LLMs using a council of AIs moderted by a veto system. The council judges an agent's actions outputs based on specified categories.


rich-text-to-image

Rich-Text-to-Image Generation


qoi

The “Quite OK Image Format” for fast, lossless image compression


fromage

🧀 Pytorch code for the Fromage optimiser.


AI-Functions

AI-Powered Function Magic: Never code again with GPT models!


traitlets

A lightweight Traits like module


Semantic-Segment-Anything

Automated dense category annotation engine that serves as the initial semantic labeling for the Segment Anything dataset (SA-1B).


autoresearcher

⚡ Automating scientific workflows with AI ⚡


OpenAGI

OpenAGI: When LLM Meets Domain Experts


AutoHOOT

Automatic High-Order Optimization for Tensors


Nightly release of ControlNet 1.1


This script allows you to utilize OpenAI's ChatGPT and Whisper APIs in Python to integrate several AI services, including speech-to-text (STT), natural language processing (NLP).


Listener

Python Discord bot that works with STT as input using Whisper from OpenAI.


awesome-decentralized-llm

Collection of LLM resources that can be used to build products you can "own" or to perform reproducible research.


socrate

Run `npm i -g socrate` to install a discussion room for using GPT personalities with internal monologues to debate problems. Provide a problem to start, or customize the settings of the debate room. Custom agents incoming!


ai-legion

An LLM-powered autonomous agent platform


dla

Deep learning for audio processing


blog-finetuning-llama-adapters

Supplementary material for "Understanding Parameter-Efficient Finetuning of Large Language Models: From Prefix Tuning to Adapters"


stable-diffusion-webui-depthmap-script

High Resolution Depth Maps for Stable Diffusion WebUI


ai-research-assistant

Aria is Your AI Research Assistant Powered by GPT Large Language Models


RRHF

[NIPS2023] RRHF & Wombat


langtest

Deliver safe & effective language models


micro-agent

A tiny implementation of an autonomous agent powered by LLMs (OpenAI GPT-4)


TemporalKit

An all in one solution for adding Temporal Stability to a Stable Diffusion Render via an automatic1111 extension


Official repo for consistency models.


Painter

Painter & SegGPT Series: Vision Foundation Models from BAAI


Instruction Tuning with GPT-4


diffgram

The AI Datastore for Schemas, BLOBs, and Predictions. Use with your apps or integrate built-in Human Supervision, Data Workflow, and UI Catalog to get the most value out of your AI Data.


exprgrad

An experimental deep learning framework for Nim based on a differentiable array programming language


AgentGPT

🤖 Assemble, configure, and deploy autonomous AI Agents in your browser.


GlobalMatch

GlobalMatch: Registration of forest terrestrial point clouds by global matching of relative stem positions [ISPRS 2023]


gitea

Git with a cup of tea! Painless self-hosted all-in-one software development service, including Git hosting, code review, team collaboration, package registry and CI/CD


pydub

Manipulate audio with a simple and easy high level interface


Official supported Python bindings for llama.cpp + gpt4all


CenterCLIP

[SIGIR 2022] CenterCLIP: Token Clustering for Efficient Text-Video Retrieval. Also, a text-video retrieval toolbox based on CLIP + fast pyav video decoding.


babyagi-asi

BabyAGI: an Autonomous and Self-Improving agent, or BASI


EditAnything

Edit anything in images  powered by segment-anything, ControlNet, StableDiffusion, etc.


simsity

Super Simple Similarities Service


HCP-Diffusion

A universal Stable-Diffusion toolbox


turbopilot

Turbopilot is an open source large-language-model based code completion engine that runs locally on CPU


ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型


tight-pac-bayes

Code for PAC-Bayes Compression Bounds So Tight That They Can Explain Generalization, NeurIPS 2022


RecAlign

Chrome extension to  filter your feed with LLM according to an explicitly stated and user-editable preference.


svdiff-pytorch

Implementation of "SVDiff: Compact Parameter Space for Diffusion Fine-Tuning"


segment-anything-video

MetaSeg: Packaged version of the Segment Anything repository


researchgpt

A LLM based research assistant that allows you to have a conversation with a research paper


VitsServer

🌻 VITS ONNX TTS server designed for fast inference 🔥


tabby

Self-hosted AI coding assistant


Inquiry videos with ChatGPT


GlueStick

Joint Deep Matcher for Points and Lines 🖼💥🖼 (ICCV 2023)


opensource-website

Twitter's open source website, identifying projects we've released, organizations we support, and the work we do to support open source.


legalbench

An open science effort to benchmark legal reasoning in foundation models


ReAct

[ICLR 2023] ReAct: Synergizing Reasoning and Acting in Language Models


CLAP

Contrastive Language-Audio Pretraining


lerf

Code for LERF: Language Embedded Radiance Fields


U-ViT

A PyTorch implementation of the paper "All are Worth Words: A ViT Backbone for Diffusion Models".


clownfish

Constrained Decoding for LLMs against JSON Schema


GroundingDINO

Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"


Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions (ICCV 2023)


Cloud Runtime for AI Agents


PromptMate

PromptMate is your AI partner to develop code.


autopilot

Code Autopilot, a tool that uses GPT to read a codebase, create context and solve tasks.


Grounded-Segment-Anything

Grounded-SAM: Marrying Grounding-DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything


PAPA

Repository for the PopulAtion Parameter Averaging (PAPA) paper


AlpacaDataCleaned

Alpaca dataset from Stanford, cleaned and curated


CLIP-SAM

Experiment on combining CLIP with SAM to do open-vocabulary image segmentation.


SpanMarkerNER

SpanMarker for Named Entity Recognition


Zero-Shot Video Editing Using Off-The-Shelf Image Diffusion Models


FollowYourPose

[AAAI 2024] Follow-Your-Pose: This repo is the official implementation of "Follow-Your-Pose : Pose-Guided Text-to-Video Generation using Pose-Free Videos"