intrinsic-lora

Official repo of Generative Models: What do they know? Do they know things? Let's find out!


about-time

A cool helper for tracking time and throughput of code blocks, with beautiful human friendly renditions.


kueue

Kubernetes-native Job Queueing


MedRAG

Code for the MedRAG toolkit


The official PyTorch implementation of Google's Gemma models


opendream

An extensible, easy-to-use, and portable diffusion web UI 👨🎨


PQDiff

[ICLR 2024] Continuous-Multiple Image Outpainting in One-Step via Positional Query and A Diffusion-based Approach   Link: https://arxiv.org/abs/2401.15652


Neural-Network-Diffusion

We introduce a novel approach for parameter generation, named neural network diffusion (\textbf{p-diff}, p stands for parameter), which employs a standard latent diffusion model to synthesize a new set of parameters


highway

Performance-portable, length-agnostic SIMD with runtime dispatch


comfyui-python-api

Utilities library for working with the ComfyUI API


Latte

Latte: Latent Diffusion Transformer for Video Generation.


thisnotthat

A visual labeling system implemented in Jupyter widgets.


datamapplot

Creating beautiful plots of data maps


pyccel

Python extension language using accelerators


pychromatic

A python module for better color palettes


refurb

A tool for refurbishing and modernizing Python codebases


parsl

Parsl - a Python parallel scripting library


VQGAN from LDM without hell of dependencies


data-juicer

A one-stop data processing system to make data higher-quality, juicier, and more digestible for LLMs!  🍎 🍋 🌽 ➡ ➡🍸 🍹 🍷为大语言模型提供更高质量、更丰富、更易”消化“的数据！


jepa

PyTorch code and models for V-JEPA self-supervised learning from video.


minbpe

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.


dysts

More than a hundred strange attractors


StableCascade

Official Code for Stable Cascade


prismatic-vlms

A flexible and efficient codebase for training visually-conditioned language models (VLMs)


SuperAGI

<⚡> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.


KIVI

KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache


The official implementation of the paper "Read to Play (R2-Play): Decision Transformer with Multimodal Game Instruction".


MetaTree

Official implementation of MetaTree: Learning a Decision Tree Algorithm with Transformers


Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answer based on user queries.


LoRD

Low-Rank adapter extraction for fine-tuned transformers model


vllm-lora

vLLM with support for efficient LoRA updates.


ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generation


crewAI

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.


Eel

A little Python library for making simple Electron-like HTML/JS GUI apps


minihf

MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user develop their prompts into full models.


SPIN

The official implementation of Self-Play Fine-Tuning (SPIN)


Bunny

A family of lightweight multimodal models.


sso

Repository for Skill Set Optimization


gsplat

CUDA accelerated rasterization of gaussian splatting


OLMo

Modeling, training, eval, and inference code for OLMo


TensorRT

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.


torchtrail

torchtrail: trace the graph of torch functions and modules for visualization, reports, etc


phatgoose

Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"


quartic-transformer

Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)


comfyui-reactor-node

Fast and Simple Face Swap Extension Node for ComfyUI


implicitMAP

Code to accompany "Implicit Maximum a Posteriori Filtering via Adaptive Optimization" by Gianluca Bencomo, Jake Snell, and Tom Griffiths (under review at ICLR 2023).


polygrad-world-models

Official code for "World Models via Policy-Guided Trajectory Diffusion"


dive

A tool for exploring each layer in a docker image


llm-swarm

Manage scalable open LLM inference endpoints in Slurm clusters


bertviz

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)


rag-containers

Ready-to-go containerized RAG service. Implemented with text-embedding-inference + Qdrant/LanceDB.


inference

A fast, easy-to-use, production-ready inference server for computer vision supporting deployment of many popular model architectures and fine-tuned models.


Atom

Atom: Low-bit Quantization for Efficient and Accurate LLM Serving


A high-level nodegraph implemented in PySide2, easy to expand and easy to debug


cvGPUSpeedup

A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!


quax

Multiple dispatch over abstract array types in JAX.


LGM

LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creation.


EscherNet

EscherNet: A Generative Model for Scalable View Synthesis


optimi

Fast, Modern, & Low Precision PyTorch Optimizers


FisherRF

FisherRF: Active View Selection and Uncertainty Quantification for Radiance Fields using Fisher Information


InstanceDiffusion

Code release for "InstanceDiffusion: Instance-level Control for Image Generation"


ComfyUI-TiledDiffusion

Tiled Diffusion, MultiDiffusion, Mixture of Diffusers, and optimized VAE


flashinfer

FlashInfer: Kernel Library for LLM Serving


JAX bindings for Flash Attention v2


stable-audio-tools

Generative models for conditional audio generation


A turnkey command for converting a LaTeX source to ar5iv-style HTML


YOLO-World

Real-Time Open-Vocabulary Object Detection


comfyui-prompt-control

ComfyUI nodes for prompt editing and LoRA control


metavoice-src

Foundational model for human-like, expressive TTS


lectures

Material for cuda-mode lectures


steampipe

Zero-ETL, infinite possibilities. Live query APIs, code & more with SQL. No DB required.


BCEmbedding

Netease Youdao's open-source embedding and reranker models for RAG products.


Flash-Attention-Softmax-N

CUDA and Triton implementations of Flash Attention with SoftmaxN.


Lora-Training-in-Comfy

This custom node lets you train LoRA directly in ComfyUI!


ovsam

[arXiv preprint] The official code of paper "Open-Vocabulary SAM".


2D Positional Embeddings for Webpage Structural Understanding 🦙👀


pytest-memray

pytest plugin for easy integration of memray memory profiler


[ICLR'24 Spotlight] Uni3D: 3D Visual Representation from BAAI


kserve

Standardized Serverless ML Inference Platform on Kubernetes


A curated list of papers and open-source resources focused on 3D AIGC.


ArchiveBox

🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...


self-remixing

Official implementation of Self-Remixing


EAT

Code and models for "EAT: Self-Supervised Pre-Training with Efficient Audio Transformer"


datatrove

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.


joytag

The JoyTag Image Tagging Model


MoE-LLaVA

Mixture-of-Experts for Large Vision-Language Models


OnnxSlim

A Toolkit to Help Optimize Large Onnx Model


pyterrier

A Python framework for performing information retrieval experiments, building on http://terrier.org/


SUPIR

SUPIR aims at developing Practical Algorithms for Photo-Realistic Image Restoration In the Wild


sft-llm

Scaling Sparse Fine-Tuning to Large Language Models


AnimateDiff-MotionDirector

MotionDirector Training For AnimateDiff. Train a MotionLoRA and run it on any compatible AnimateDiff UI.


AnimateLCM

AnimateLCM: Accelerating the Animation of Personalized Diffusion Models and Adapters with Decoupled Consistency Learning


Code and dataset for photorealistic Codec Avatars driven from audio


ofelia

A docker job scheduler (aka. crontab for docker)


nuxt

The Intuitive Vue Framework.


leptonai

A Pythonic framework to simplify AI service building


NU-Wave 2: A General Neural Audio Upsampling Model for Various Sampling Rates @ INTERSPEECH 2022


librarian

Better Bookmarks Search w/ Transformers


pyrsistent

Persistent/Immutable/Functional data structures for Python


VMamba

VMamba: Visual State Space Models，code is based on mamba


folx

Implementation of Forward Laplacian algorithm in JAX


zed

Code at the speed of thought – Zed is a high-performance, multiplayer code editor from the creators of Atom and Tree-sitter.


openmodelz

One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP, AWS, Lambda labs, your home lab, or even a single machine).


triton-autodiff

Experiment of using Tangent to autodiff triton


talos

Talos Linux is a modern Linux distribution built for Kubernetes.


RPG-DiffusionMaster

Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMs (PRG)


nos

⚡ A fast and flexible PyTorch inference server that runs locally, on any cloud or AI HW.


ComfyUI-InstantID

Thin Custom Node wrapper for InstantID in ComfyUI.


self-rewarding-lm-pytorch

Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI


LibreChat

Enhanced ChatGPT Clone: Features OpenAI, Assistants API, Azure, GPT-4 Vision, Mistral, Bing, Anthropic, OpenRouter, Google Gemini, AI model switching, message search, langchain, DALL-E-3, ChatGPT Plugins, OpenAI Functions, Secure Multi-User System, Presets, completely open-source for self-hosting. More features in development


SuGaR

Official PyTorch implementation of SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering


Depth-Anything

Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data. Foundation Model for Monocular Depth Estimation


supervision

We write your reusable computer vision tools. 💜


Text-to-3D Generation within 5 Minutes


threefiner

An interface for text-guided mesh refinement.


cookbook

Deep learning for dummies. All the practical details and useful utilities that go into working with real models.


ml-engineering

Machine Learning Engineering Open Book

Creative Commons Attribution Share Alike 4.0 International


fMRI-reconstruction-NSD

fMRI-to-image reconstruction on the NSD dataset.


FlyingCarpet

Cross-platform AirDrop. File transfer between Android, iOS, Linux, macOS, and Windows over ad hoc WiFi. No network infrastructure required, just two devices with WiFi chips in close range.


sd-webui-semantic-guidance

Unofficial implementation of "SEGA: Instructing Text-to-Image Models using Semantic Guidance". Semantic Guidance gives you more control over the semantics of an image given an additional text prompt. An extension for Automatic1111 WebUI.


hf-hub

Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package


LooseControl

Lifting ControlNet for Generalized Depth Conditioning


mediapy

This Python library makes it easy to display images and videos in a notebook.


Download videos from YouTube-8M dataset for testing


ComfyUI-Latent-Modifiers

A repository of ComfyUI nodes which modify the latent during the diffusion process.


TinyCLIP

[ICCV2023] TinyCLIP: CLIP Distillation via Affinity Mimicking and Weight Inheritance


jaxirl

Contains JAX implementation of algorithms for inverse reinforcement learning


purejaxrl

Really Fast End-to-End Jax RL Implementations


distributed-llama

Run LLMs on weak devices or make powerful devices even more powerful by distributing the workload and dividing the RAM usage.


magi

Generate a transcript for your favourite Manga: Detect manga characters, text blocks and panels. Order panels. Cluster characters. Match texts to their speakers. Perform OCR.


An extensive node suite that enables ComfyUI to process 3D inputs (Mesh & UV Texture, etc) using cutting edge algorithms (3DGS, NeRF, etc.)


moondream

tiny vision language model


depyf

depyf is a tool to help you understand and adapt to PyTorch compiler torch.compile.


WorldDreamer

WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokens


llama-moe

⛷ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training


LLM-Shearing

[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning


honeybee

The official implementation of project "Honeybee"


golden-layout

A multi window layout manager for webapps


quartodoc

Generate API documentation with quarto


WhisperSpeech

An Open Source text-to-speech system built by inverting Whisper.


sglang

SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.


Implementation of Dreamer v3 in pytorch.


stsl-inverse-edit

Second-order Tweedie from Surrogate Loss


InfoBatch

Lossless Training Speed Up by Unbiased Dynamic Data Pruning


AlphaCodium

Official implementation for the paper: "Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineering""


LLM-Pruner

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support LLaMA, Llama-2, BLOOM, Vicuna, Baichuan, etc.


segment-anything-with-clip

Segment Anything combined with CLIP


ComfyUI-PhotoMaker-ZHO

Unofficial implementation of PhotoMaker for ComfyUI


einx

Tensor Operations in Einstein-Inspired Notation for Python.


TriplaneGaussian

TriplaneGaussian: A new hybrid representation for single-view 3D reconstruction.


nanotron

Minimalistic large language model 3D-parallelism training


Vim

Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model


InternLM

Official release of InternLM2 7B and 20B base and chat models. 200K context support


official implementation of "Interpreting CLIP's Image Representation via Text-Based Decomposition"


T2VScore: Towards A Better Metric for Text-to-Video Generation


marlin

FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.


An implementation of the paper "GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generation"


ZeroShape

Code repository for "ZeroShape: Regression-based Zero-shot Shape Reconstruction".


InstantID

InstantID : Zero-shot Identity-Preserving Generation in Seconds 🔥


waifuc

Efficient Train Data Collector for Anime Waifu


PhotoMaker

PhotoMaker


FreeNoise

[ICLR 2024] Code for FreeNoise based on VideoCrafter


satclip

PyTorch implementation of SatCLIP


smoothquant

[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models


A unified diffusers implementation for MVDream and ImageDream


SWE-bench

[ICLR 2024] SWE-Bench: Can Language Models Resolve Real-world Github Issues?


Gooey

Turn (almost) any Python command line program into a full GUI application with one line


litellm

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)


LongLM

LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning


LLM-FineTuning-Large-Language-Models

LLM (Large Language Model) FineTuning


BakedAvatar

Pytorch Code for "BakedAvatar: Baking Neural Fields for Real-Time Head Avatar Synthesis"


PointAvatar

Official Repository for CVPR 2023 paper PointAvatar: Deformable Point-based Head Avatars from Videos.


brever

Speech enhancement in noisy and reverberant environments using deep neural networks


controlGIF

Animate a given image with animatediff and controlnet


LLMLingua

To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.


CCSR

Official codes of CCSR: Improving the Stability of Diffusion Models for Content Consistent Super-Resolution


mamba-jax

Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX


[ICLR 2024] Official implementation of DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior


CALM-pytorch

Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind


U-Mamba

U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentation


Geo-FNO

Geometry-Aware Fourier Neural Operator (Geo-FNO)


Denoising-ViT

This is the official code release for our work, Denoising Vision Transformers.


KEN: Relational Data Embeddings

Creative Commons Attribution 4.0 International


SAM-Adapter-PyTorch

Adapting Meta AI's Segment Anything to Downstream Tasks with Adapters and Prompts


vstar

PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"


dreamtalk

Official implementations for paper: DreamTalk: When Expressive Talking Head Generation Meets Diffusion Probabilistic Models


sd-dino

Official Implementation of paper "A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondence"


jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer


Octopus

🐙Octopus, an embodied vision-language model trained with RLEF, emerging superior in embodied visual planning and programming.


HyPe

HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation [ACL 2023]


ComfyScript

A Python front end and library for ComfyUI


toolformer-lamini

Data generation pipeline similar to toolformer


cruxeval

CRUXEval: Code Reasoning, Understanding, and Execution Evaluation


zero-bubble-pipeline-parallelism

Zero Bubble Pipeline Parallelism


flash-linear-attention

Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton


multimodal-maestro

Effective prompting for Large Multimodal Models like GPT-4 Vision, LLaVA or CogVLM. 🔥


art

🎨 ASCII art library for Python


End2End Multi-View Feature Matching with Differentiable Pose Optimization


DiffusionEdge

Code for AAAI 2024 paper: "DiffusionEdge: Diffusion Probabilistic Model for Crisp Edge Detection"


DCR

Official Pytorch repo of CVPR'23  and NeurIPS'23 papers on understanding replication in diffusion models.


[arXiv 2023] DreamGaussian4D: Generative 4D Gaussian Splatting


ComfyUI-Flowty-LDSR

LDSR custom node for ComfyUI


maestro

Unix-like kernel written in Rust


QAnything

Question and Answer based on Anything.


Scaffold-GS

Official implementation of "Scaffold-GS: Structured 3D Gaussians for View-Adaptive Rendering"


ControlLoRA Version 2: A Lightweight Neural Network To Control Stable Diffusion Spatial Information Version 2


dlrover

DLRover: An Automatic Distributed Deep Learning System


dlpark

A Rust Library for High-Performance Tensor Exchange with Python


mixtral-offloading

Run Mixtral-8x7B models in Colab or consumer desktops


Code for "Point2CAD: Reverse Engineering CAD Models from 3D Point Clouds"


MotionCtrl

MotionCtrl: A Unified and Flexible Motion Controller for Video Generation


DiffusionLight

code release for the paper "DiffusionLight: Light Probes for Free by Painting a Chrome Ball"


ao

The torchao repository contains api's and workflows for quantization and pruning gpu models.


Smooth-Diffusion

Smooth Diffusion: Crafting Smooth Latent Spaces in Diffusion Models


Jovimetrix

ComfyUI node suite for composition, stream webcams or media files in and out, animation, flow control, making masks, shapes and textures like Houdini and Substance Designer, read MIDI devices. Also has colorization options for workflow nodes via regex, groups and each node.


infini-Z

A Self Replicating 3D Printer


🤔  What happens when I type kubectl run?


Tightinator

Automatic peak detection and timing analysis web app


SPM

Official implementation of paper "One-dimensional Adapter to Rule Them All: Concepts, Diffusion Models and Erasing Applications".


Squirrel-RIFE

效果更好的补帧软件，显存占用更小，是DAIN速度的10-25倍，包含抽帧处理，去除动漫卡顿感


CLIP-Parrot-Bias

Parrot Captions Teach CLIP to Spot Text


annotated-mamba

Annotated version of the Mamba paper


humannorm

The official implementation of HumanNorm


Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)


havatar

[TOG 2023] HAvatar: High-fidelity Head Avatar via Facial Model ConditionedNeural Radiance Field


DiffMorpher

Official Code for DiffMorpher: Unleashing the Capability of Diffusion Models for Image Morphing


Website for DiffPortrait3D


TinySAM

Official PyTorch implementation of "TinySAM: Pushing the Envelope for Efficient Segment Anything Model"


ComfyUI-Iterative-Mixer

Nodes that implement iterative mixing of samples to help with upscaling quality


taylor-series-linear-attention

Explorations into the recently proposed Taylor Series Linear Attention


Easy and fast 2d human and animal multi pose estimation using SOTA ViTPose [Y. Xu et al., 2022] Real-time performances and multiple skeletons supported.


alta-typst

A simple Typst CV template, inspired by AltaCV by LianTze Lim.


Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Models, a no lighting baked texture generative model


sd-webui-temporal

A "loopback on steroids" type of extension for Stable Diffusion Web UI.


StreamDiffusion

StreamDiffusion: A Pipeline-Level Solution for Real-Time Interactive Generation


VidToMe

VidToMe: Video Token Merging for Zero-Shot Video Editing


llmperf

LLMPerf is a library for validating and benchmarking LLMs


PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs


pixelsplat

Code for "pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstruction" by David Charatan, Sizhe Li, Andrea Tagliasacchi, and Vincent Sitzmann.


Relative Human dataset, CVPR 2022


ROMP

Monocular, One-stage, Regression of Multiple 3D People and their 3D positions & trajectories in camera & global coordinates. ROMP[ICCV21], BEV[CVPR22], TRACE[CVPR2023]


music-transformer

My project to build and train a Music Transformer in PyTorch.


soft-moe-pytorch

Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch


Best practices for distilling large language models.


lilac

Curate better data for LLMs


Implementation of https://srush.github.io/annotated-s4


splatter-image

Official implementation of `Splatter Image: Ultra-Fast Single-View 3D Reconstruction'


mamba-minimal

Simple, minimal implementation of the Mamba SSM in one file of PyTorch.


tokenize-anything

Tokenize Anything via Prompting


TheChosenOne

Unofficial implementation of the paper "The Chosen One: Consistent Characters in Text-to-Image Diffusion Models"


OpenLRM

An open-source impl. of Large Reconstruction Models


comfyui

ComfyUI docker images


snowplow

The enterprise-grade behavioral data engine (web, mobile, server-side, webhooks), running cloud-natively on AWS and GCP


hotspot

The Linux perf GUI for performance analysis.


ConfyUI custom node: controlling output without training


demofusion-comfyui

An experimental implementation of a node that implements Demofusion technique in Comfyui


DemoFusion

Let us democratise high-resolution generation! (arXiv 2023)


ComfyUI-Marigold

Marigold depth estimation in ComfyUI


Marigold

Marigold: Repurposing Diffusion-Based Image Generators for Monocular Depth Estimation


TinkerBot-tech-for-ComfyUI-Touchpad

macOS Touchpad and smooth scrolling support for ComfyUI


comfyui-workspace-manager

A ComfyUI workflows and models management extension to organize and manage all your workflows, models in one place. Seamlessly switch between workflows, as well as import, export workflows, reuse subworkflows, install models, browse your models in a single workspace


GoogleCalendarAssistant

LLM and Langchain powered chatbot to handle Google Calendar tasks


carefree-drawboard

🎨 Infinite Drawboard in Python


AnyDoor

Official implementations for paper: Anydoor: zero-shot object-level image customization


promptbase

All things prompt engineering


sd-webui-neutral-prompt

Collision-free AND keywords for a1111 webui!


EDGE

Official PyTorch Implementation of EDGE (CVPR 2023)


X-Adapter

X-Adapter: Adding Universal Compatibility of Plugins for Upgraded Diffusion Model


NVEdit

Official PyTorch implementation for the paper "Neural Video Fields Editing"


tiny-web-metaverse

A web-based 3D virtual space lightweight framework with high flexibility, extensibility, and easy hosting, built on ECS architecture


Holodeck

Language Guided Generation of 3D Embodied AI Environments.


app.enfugue.ai

ENFUGUE is an open-source web app for making studio-grade images and video using generative AI.


An Optimized Speech-to-Text Pipeline for the Whisper Model Supporting Multiple Inference Engine


ComfyUI-Keyframed

ComfyUI nodes to facilitate prompt/parameter keyframing


HALOs

A library with extensible implementations of DPO, KTO, PPO, and other human-aware loss functions (HALOs).


autotrain-advanced

🤗 AutoTrain Advanced


skypilot

SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.


OutfitAnyone

Outfit Anyone: Ultra-high quality virtual try-on for Any Clothing and Any Person


SlimSAM

SlimSAM: 0.1% Data Makes Segment Anything Slim


PatchFusion

An End-to-End Tile-Based Framework for High-Resolution Monocular Metric Depth Estimation


diffusion-point-cloud

:thought_balloon: Diffusion Probabilistic Models for 3D Point Cloud Generation (CVPR 2021)


dreamoving-project

Official implementation of DreaMoving


ToolkenGPT

ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings - NeurIPS 2023 (oral)


llm-reasoners

A library for advanced large language model reasoning


diffusion-motion-transfer

Official Pytorch Implementation for "Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfer""


Achievement-Distillation

Official PyTorch implementation of "Discovering Hierarchical Achievements in Reinforcement Learning via Contrastive Learning" (NeurIPS 2023)


My-exp-Gaussian

My Modification to vanilla 3D Gaussians


EdgeSAM

Official PyTorch implementation of "EdgeSAM: Prompt-In-the-Loop Distillation for On-Device Deployment of SAM"


FreeInit

FreeInit: Bridging Initialization Gap in Video Diffusion Models


llmware

Providing enterprise-grade LLM-based development framework, tools, and fine-tuned models.


definitive-image-comparison-slider

Light Vanilla Javascript library to compare multiples images with sliders. Also, you can add text and filters to your images.


get

Generative Equilibrium Transformer


AnimateZero

Official PyTorch implementation for the paper "AnimateZero: Video Diffusion Models are Zero-Shot Image Animators"


comfyui-browser

An image/video/workflow browser and manager for ComfyUI.


OneLLM

OneLLM: One Framework to Align All Modalities with Language


llama-mistral

Inference code for Mistral and Mixtral hacked up into original Llama implementation


OpenMoE

A family of open-sourced Mixture-of-Experts (MoE) Large Language Models


llm-finetuning

Guide for fine-tuning Llama/Mistral/CodeLlama models and more


papermage

library supporting NLP and CV research on scientific papers


improved-precision-and-recall-metric

Improved Precision and Recall Metric for Assessing Generative Models - Official TensorFlow Implementation


mamba-chat

Mamba-Chat: A chat LLM based on the state-space model architecture 🐍


Finetuning Llama-2-7b using QLoRA using TinyStories dataset


LLMCompiler

LLMCompiler: An LLM Compiler for Parallel Function Calling


superduperdb

🔮 SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.


VividTalk

VividTalk: One-Shot Audio-Driven Talking Head Generation Based on 3D Hybrid Prior


Convert your videos to densepose and use it on MagicAnimate


This repository contains Jax implementations of Monte Carlo conformal prediction, plausibility regions and statistical annotation aggregation from our recent work on uncertain ground truth (TMLR'23 and ArXiv pre-print).


HCL

[CVPR'23 Highlight] Heterogeneous Continual Learning.


style-aligned

Official code for "Style Aligned Image Generation via Shared Attention"


OneTrainer

OneTrainer is a one-stop solution for all your stable diffusion training needs.


IMProv

IMProv: Inpainting-based Multimodal Prompting for Computer Vision Tasks


EfficientSAM

EfficientSAM: Leveraged Masked Image Pretraining for Efficient Segment Anything


DensePoseFnL

Fast and Light DensePose implementation


Video-Motion-Customization

VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Models


DeepCache

DeepCache: Accelerating Diffusion Models for Free


VideoSwap

Code for VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondence


DiffiT

Official Repository for DiffiT: Diffusion Vision Transformers for Image Generation


T-Rex

Detect and count any objects by visual prompting


SparseDC

[ArXiv 2023] SparseDC: Depth Completion from sparse and non-uniform inputs


NodeGPT

ComfyUI Extension Nodes for Automated Text Generation.


SplaTAM

SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAM


GPS-Gaussian

GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesis


calibur

Conversion between different conventions of camera matrices and transform matrices.


AnimateAnything

Fine-Grained Open Domain Image Animation with Motion Guidance


SurfD

Surf-D: High-Quality Surface Generation for Arbitrary Topologies using Diffusion Models


X-Dreamer

A pytorch implementation of “X-Dreamer: Creating High-quality 3D Content by Bridging the Domain Gap Between Text-to-2D and Text-to-3D Generation”


FSGS

"FSGS: Real-Time Few-Shot View Synthesis using Gaussian Splatting", Zehao Zhu, Zhiwen Fan, Yifan Jiang, Zhangyang Wang


GraphDreamer

Official implementation of GraphDreamer


wgd

Official project page for Estimating the Rate-Distortion Function by Wasserstein Gradient Descent


ComfyUI-MagicAnimate

Easily use MagicAnimate within ComfyUI


mlx

MLX: An array framework for Apple silicon


SegAnyGAussians

The official implementation of SAGA (Segment Any 3D GAussians)


llm-course

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.


gaussian-grouping

Gaussian Grouping for open-world Anything reconstruction, segmentation and editing.


magicoder

Magicoder: Source Code Is All You Need


fine-tune-mistral

Fine-tune mistral-7B on 3090s, a100s, h100s


Run GGML models with Kubernetes.


comfy-trt-test

attempt to use TensorRT with ComfyUI


PD-FGC-inference

This is official inference code of PD-FGC


gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.


self-operating-computer

A framework to enable multimodal models to operate a computer.


Embed arbitrary modalities (images, audio, documents, etc) into large language models.


hold

This is a repository for HOLD, a method that jointly reconstructs hands and objects from monocular videos without assuming a pre-scanned object template.


threestudio-meshfitting

A simple extension of ThreeStudio, enabling the use of neural representation to fit a 3D mesh.


3D Gaussian Splatting extension of threestudio.


threestudio-mvdream

MVDream extension of threestudio.


marker

Convert PDF to markdown quickly with high accuracy


unsloth

5X faster 60% less memory QLoRA finetuning


Consume-ComfyUI-Workflows

A collection of some of my basic ComfyUI workflows. These are meant to act as building block to construct larger workflows of your own.


TexForce

Official PyTorch codes for "Enhancing Diffusion Models with Text-Encoder Reinforcement Learning"


Code repository for Zero123++: a Single Image to Consistent Multi-view Diffusion Base Model.


GShell

Official implentation of "Ghost on the Shell: An Expressive Representation of General 3D Shapes" (ICLR 2024 Oral)


AlignProp

AlignProp uses direct reward backpropogation for the alignment of large-scale text-to-image diffusion models. Our method is 25x more sample and compute efficient than reinforcement learning methods (PPO) for finetuning Stable Diffusion


HumanSD

[ICCV 2023] The official implementation of paper "HumanSD: A Native Skeleton-Guided Diffusion Model for Human Image Generation"


gaussian-splatting-cuda

3D Gaussian Splatting, reimagined: Unleashing unmatched speed with C++ and CUDA from the ground up!


A growing curation of Text-to-3D, Diffusion-to-3D works.


logos-shift-client

Replace expensive LLM calls with finetunes automatically


neosr

neosr is a framework for training real-world single-image super-resolution networks.


Amphion

Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio, music, and speech generation research and development.


LAION-Face

The human face subset of LAION-400M for large-scale face pretraining.


SAMPro3D: Locating SAM Prompts in 3D for Zero-Shot Scene Segmentation


4D-fy: Text-to-4D Generation Using Hybrid Score Distillation Sampling


mesh-gpt

MeshGPT: Generating Triangle Meshes with Decoder-Only Transformers


llamafile

Distribute and run LLMs with a single file.


GART

GART: Gaussian Articulated Template Models


mip-splatting

Mip-Splatting: Alias-free 3D Gaussian Splatting


SketchVideo

[arXiv 2023] Sketch Video Synthesis


RLCD

Reproduction of "RLCD Reinforcement Learning from Contrast Distillation for Language Model Alignment


faster-lcm

Faster LCM is a script which enables to transfer image styles at 45fps with RTX4090, 33fps with A100.


JungleGym

An Open Source Playground with Agent Datasets and APIs for building and testing your own Autonomous Web Agents


DynamiCrafter

DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors


LLaMA-VID

Official Implementation for LLaMA-VID: An Image is Worth 2  Tokens in Large Language Models


magic-animate

MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model


ComfyUI-Frame-Interpolation

A custom node set for Video Frame Interpolation in ComfyUI.


torchnvjpeg

Decode JPEG image on GPU using PyTorch


nvjpeg-torch

Python binding for nvjpeg encoding with torch.


GaussianEditor

GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splatting


ComfyUI-sampler-lcm-alternative

ComfyUI Custom Sampler nodes that adds a new improved LCM sampler function


rellm

Exact structure out of any language model completion.


axum

Ergonomic and modular web framework built with Tokio, Tower, and Hyper


fireside-chat

A multi-user chat bot implemented in pure Rust using Mistral-7B with HuggingFace/Candle over Axum Websockets and a Leptos (Wasm) frontend!!


purz-comfyui-workflows

Purz's ComfyUI Workflows


direct-preference-optimization

Reference implementation for DPO (Direct Preference Optimization)


DISSC

Official repository for "Speaking Style Conversion With Discrete Self-Supervised Units" (EMNLP 2023). https://arxiv.org/abs/2212.09730


Fast CUDA matrix multiplication from scratch


jeometric

Graph neural networks in JAX.


Open-NLLB

Effort to open-source NLLB checkpoints.


sd-webui-loractl

An Automatic1111 extension for dynamically controlling the weights of LoRAs during image generation


Whisky

A modern Wine wrapper for macOS built with SwiftUI


WACV2024 - Scale-Adaptive Feature Aggregation for Efficient Space-Time Video Super-Resolution


taipy

Turns Data and AI algorithms into production-ready web applications in no time.


groundingLMM

Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.


InstructCV

[ ICLR 2024 ] Official Codebase for "InstructCV: Instruction-Tuned Text-to-Image Diffusion Models as Vision Generalists"


Code for the paper "Pix2Video: Video Editing using Image Diffusion"


observ

Observ 👁 Reactive state management


LLaMA-Factory

Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)


mistral-src

Reference implementation of Mistral AI 7B v0.1 model.


MergeLM

Codebase for Merging Language Models


UltraFastBERT

The repository for the code of the UltraFastBERT paper


Source code of APNet2, a vocoder


vit.cpp

Inference Vision Transformer (ViT) in plain C/C++ with ggml


big-AGI

💬 Personal AI application powered by GPT-4 and beyond, with AI personas, AGI functions, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy and gift #big-AGI-energy! Using Next.js, React, Joy.


mcvd-pytorch

Official implementation of MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolation (https://arxiv.org/abs/2205.09853)


EPro-PnP

[CVPR 2022 Oral, Best Student Paper] EPro-PnP: Generalized End-to-End Probabilistic Perspective-n-Points for Monocular Object Pose Estimation


testcontainers-rs

A library for integration-testing against docker containers from within Rust.


gafar

Geometry-aware Face Reconstruction


candlex

An Nx backend for candle machine learning framework


Custom node and script for sending webcam to ComfyUI


DuckTrack

Multimodal computer agent data collection program


Implicit-Language-Q-Learning

Official code from the paper "Offline RL for Natural Language Generation with Implicit Language Q Learning"


dask-sql

Distributed SQL Engine in Python using Dask


MVImgNet

CVPR2023 | MVImgNet: A Large-scale Dataset of Multi-view Images


LLaVA-Plus-Codebase

LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills


LLaVA-Interactive-Demo

LLaVA-Interactive-Demo


diffseg

DiffSeg is an unsupervised zero-shot segmentation method using attention information from a stable-diffusion model. This repo implements the main DiffSeg algorithm and additionally includes an experimental feature to add semantic labels to the masks based on a generated caption.


Chat-UniVi

Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding


pyglet

pyglet is a cross-platform windowing and multimedia library for Python, for developing games and other visually rich applications.


embodied-generalist

Official code repository for 3D embodied generalist agent LEO


sliders

Concept Sliders for Precise Control of Diffusion Models


KandinskyVideo

KandinskyVideo — multilingual end-to-end text2video latent diffusion model


nendo

The Nendo AI Audio Tool Suite


minimax

Efficient baselines for autocurricula in JAX.


distilabel

⚗ AI Feedback framework for scalable LLM alignment


ziplora-pytorch

Implementation of "ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAs"


ComfyUI-SVD

Experimental use of stable-video-diffusion in ComfyUI


torchsynth

A GPU-optional modular synthesizer in pytorch, 16200x faster than realtime, for audio ML researchers.


DiffuseIT

Official repository of "Diffusion-based Image Translation using Disentangled Style and Content Representation" ( ICLR 2023 )


nalgebra

Linear algebra library for Rust.


The official implementation of paper: Alphazero-like Tree-Search can guide large language model decoding and training


fastfeedforward

A repository for log-time feedforward networks


udlbook

Understanding Deep Learning - Simon J.D. Prince


mvdream-hf

Huggingface implementation of MVDream for easy import


HierSpeechpp

The official implementation of HierSpeech++


LucidDreamer

Official implementation of "LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matching"


chatlab

⚡ Fast Experimentation 🧪 with OpenAI Chat Function Calling


canopy

Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone


imgpilot

Turn the draft into amazing artwork with the power of Real-Time Latent Consistency Model


rustgpt

RustGPT is a ChatGPT UI built with Rust + HTMX: the power of Rust coupled with the simplicity of HTMX 💚


text-to-image

A single API for text-to-image, built on fal that supports all Stable Diffusion variants


Video-LLaVA

Video-LLaVA: Learning United Visual Representation by Alignment Before Projection


RealtimeTTS

Converts text to speech in realtime


rgthree-comfy

Making ComfyUI more comfortable!


LongBench

LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding


gradnorm-pytorch

A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch


ComfyUI-KJNodes

Various custom nodes for ComfyUI


diffusers-burn

A diffusers API in Burn (Rust)


StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models


neural-cherche

Neural Search


ScaleCrafter

[ICLR 2024 Spotlight] Official implementation of ScaleCrafter for higher-resolution visual generation at inference time.


StabilityMatrix

Multi-Platform Package Manager for Stable Diffusion


lorax

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs


skim

Fuzzy Finder in rust!


portable-simd

The testing ground for the future of portable SIMD in Rust


pannellum

Pannellum is a lightweight, free, and open source panorama viewer for the web.


implementation of the IPAdapter models for HF Diffusers


ESRGAN-candle-rs

ESRGAN implemented in rust with candle


comfyui-tooling-nodes

Nodes for using ComfyUI as a backend for external tools. Send and receive images directly without filesystem upload/download.


digthatdata-comfyui-workflows

Sharing some of my secret sauce ;)


ComfyUI-Serving-Toolkit

a node toolkit to allow serving your workflow (for example using discord


ai-exploits

A collection of real world AI/ML exploits for responsibly disclosed vulnerabilities


spandrel

Spandrel gives your project support for various PyTorch architectures meant for AI Super-Resolution, restoration, and inpainting. Based on the model support implemented in chaiNNer.


Diffusion-Pullback

Official Implementation of understanding the latent space of diffusion models through the lens of riemannian geometry (NeurIPS 2023)


segment-anything-fast

A batched offline inference oriented version of segment-anything


vdp

💧 Instill VDP (Versatile Data Pipeline) is an open-source tool to seamlessly integrate AI to process unstructured data in the modern data stack


the-art-of-debugging

The Art of Debugging


libcom

Image composition toolbox: everything you want to know about image composition


llm-decontaminator

Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"


lumos

Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"


OSRL

🤖 Elegant implementations of offline safe RL algorithms in PyTorch


webarena

Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"


hFT-Transformer

Pytorch implementation of automatic music transcription method that uses a two-level hierarchical frequency-time Transformer architecture (hFT-Transformer).


Unofficial implementation of NVIDIA P-Flow TTS paper


diffusion-sketch

Draw with Stable Diffusion


Reinforcement Learning from any language


ScaleLLM

A high-performance inference system for large language models, designed for production environments.


facer

Face analysis tools for modern research, equipped with state-of-the-art Face Parsing and Face Alignment


MCF

[MM 2023] Toward High Quality Facial Representation Learning


E2E TTS using Conditional Flow Matching (Experimental*)


PPT

Official Code for "PPT: Pre-trained Prompt Tuning for Few-shot Learning". ACL 2022


An ONNX-based implementation of the CLIP model that doesn't depend on torch or torchvision.


Intrepid

INTeractive learning via REPresentatIon Discovery


mergekit

Tools for merging pretrained large language models.


alignment-handbook

Robust recipes to align language models with human and AI preferences


CLEX

[ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models


A detailed formulae explanation on gaussian splatting


torch-splatting

A pure pytorch implementation of 3D gaussian splatting


Experimental usage of stable-fast and TensorRT.


stable-fast

Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.


MultiPivotNMT

The implementation of "Investigating Multi-Pivot Ensembling with Massively Multilingual Machine Translation Models"


mind-overflow

Open-source Rewind.ai clone written in Rust and Vue running 100% locally with whisper.cpp


SD-Latent-Interposer

A small neural network to provide interoperability between the latents generated by the different Stable Diffusion models.


InterpAny-Clearer

Clearer anytime frame interpolation & Manipulated interpolation of anything


butterfly-oft

Official implementation of "Parameter-Efficient Orthogonal Finetuning via Butterfly Factorization"


differential-dataflow

An implementation of differential dataflow using timely dataflow on Rust.


CollageRL

ICCV 2023 - Neural Collage Transfer: Artistic Reconstruction via Material Manipulation


Turn an epub or text file into an audiobook


understanding-ctx-aug

Code for the 2023 ACL Findings paper, Uncovering Hidden Consequences of Pre-training Objectives in Sequence-to-Sequence Models (Kew & Sennrich, 2023)


PyBlend

PyBlend: a package for Blender with Python 🎨


GPT4 based personalized ArXiv paper assistant bot


pytorch-softdtw-cuda

Fast CUDA implementation of (differentiable) soft dynamic time warping for PyTorch using Numba


AutoAgents

Generate different roles for GPTs to form a collaborative entity for complex tasks.


qdrant-spark

Qdrant Apache Spark connector


sd-webui-panorama-tools

Panorama editing tools for Automatic1111's Stable Diffusion WebUI


repository for 360 panorama image generation based on Stable Diffusion


EmotiVoice

EmotiVoice 😊: a Multi-Voice and Prompt-Controlled TTS Engine


ChatAnything

Official Repo for the Paper: CHATANYTHING: FACETIME CHAT WITH LLM-ENHANCED PERSONAS


S-LoRA

S-LoRA: Serving Thousands of Concurrent LoRA Adapters


flash-fft-conv

FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores


Comfy Nodes that make utilizing resources from Civitas easy as copying and pasting


cog-mediapipe-face

batch or individual face detection with mediapipe, on cog


autogen

Enable Next-Gen Large Language Model Applications. Join our Discord: https://discord.gg/pAbnFJrkgZ


SeqBoat

[NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling


infinity

Infinity is a high-throughput, low-latency REST API for serving vector embeddings, supporting a wide range of sentence-transformer models and frameworks.


ChainForge

An open-source visual programming environment for battle-testing prompts to LLMs.


rust-design-pattern

rust design patterns


miipher

Unofficial implementation of miipher


FlagEmbedding

Dense Retrieval and Retrieval-augmented LLMs


realtime-bakllava

llama.cpp with BakLLaVA model describes what does it see


mbr

Minimum Bayes Risk Decoding for Hugging Face Transformers


fmengine

Utilities for Training Very Large Models


llm

Access large language models from the command-line


punica

Serving multiple LoRA finetuned LLM as one


SoM

Set-of-Mark Prompting for LMMs


LongQLoRA

LongQLoRA: Extent Context Length of LLMs Efficiently


controlanimate

ControlAnimate Library


DeepFilterNet

Noise supression using deep filtering


DeepSeek-Coder

DeepSeek Coder: Let the Code Write Itself


MarkovJunior

Probabilistic language based on pattern matching and constraint propagation, 153 examples


CogVLM

a state-of-the-art-level open visual language model | 多模态预训练模型


[ICLR 2024] Official Implementation of Consistent4D: Consistent 360° Dynamic Object Generation from Monocular Video


A 2D Gaussian Splatting paper for no obvious reasons. Enjoy!


Pengi

An Audio Language model for Audio Tasks


prompt-optimizer

Minimize LLM token complexity to save API costs and model computations.


PASTA

PASTA: Post-hoc Attention Steering for LLMs


orca

LLM Orchestrator built in Rust


FullSubNet

PyTorch implementation of "FullSubNet: A Full-Band and Sub-Band Fusion Model for Real-Time Single-Channel Speech Enhancement."


trace

Official implementation of TRACE, the TRAjectory Diffusion Model for Controllable PEdestrians, from the CVPR 2023 paper: "Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusion".


Self-Supervised Speech Pre-training and Representation Learning Toolkit


cicada

A FOSS, cross-platform version of GitHub Actions and Gitlab CI


RealesrganRimagePicImprove

use realesrgan-ncnn-vulkan and rimage to improve the quailty and size of anime pic


SALMONN

SALMONN: Speech Audio Language Music Open Neural Network


MotionDirector

MotionDirector: Motion Customization of Text-to-Video Diffusion Models.


Three.js-based implementation of 3D Gaussian splatting


GraphWriter

A wrapper for TensorBoard SummaryWriter with real-time terminal visualization using the Rich library.


Q-Instruct

②[IQA, Low-level Vision, MLLM] Low-level visual instruction tuning, with a 200K dataset and a model zoo for fine-tuned checkpoints.


json-gpt

Fast and simple library to get correct JSON output from GPT


baby-names-analysis

Data ETL & Analysis on the dataset 'Baby Names from Social Security Card Applications - National Data'.


Unofficial Implementation of Consistency Models in pytorch


PixArt-alpha

Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis


cross-image-attention

Officail Implementation for "Cross-Image Attention for Zero-Shot Appearance Transfer"


ComfyUI custom nodes for inpainting/outpainting using the new latent consistency model (LCM)


DiST

ICCV2023: Disentangling Spatial and Temporal Learning for Efficient Image-to-Video Transfer Learning


awesome-diffusion-categorized

collection of diffusion model papers categorized by their subareas


Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation


UniDiffusion

A Diffusion training toolbox based on diffusers and existing SOTA methods, including Dreambooth, Texual Inversion, LoRA, Custom Diffusion, XTI, ....


Awesome-Diffusion-Personalization

A collection of resources on personalization with diffusion models.


Benchmarking-Awesome-Diffusion-Models

The benchmark of SOTA text-to-image diffusion models with a new benchmarking strategy based on MiniGPT-4, namely X-IQE.


Awesome-Video-Diffusion-Models

[Arxiv] A Survey on Video Diffusion Models


Diffusion-Models-pytorch

Pytorch implementation of Diffusion Models (https://arxiv.org/pdf/2006.11239.pdf)


Official repo for VGen: a holistic video generation ecosystem for video generation building on diffusion models


Implements OpenAI's new VAE decoder with batch support and no oom


comfy-consistency-vae

Implements OpenAI's new VAE decoder


maxvit

[ECCV 2022] Official repository for "MaxViT: Multi-Axis Vision Transformer". SOTA foundation models for classification, detection, segmentation, image quality, and generative modeling...


Use Jax functions in Pytorch


ComfyUI-CoreMLSuite

A set of custom nodes for ComfyUI that allow you to use Core ML models in your ComfyUI workflows.


EmerNeRF

PyTorch Implementation of EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervision


gsplat.js

JavaScript Gaussian Splatting library.


consistencydecoder

Consistency Distilled Diff VAE


diffusion-posterior-sampling

Official pytorch repository for "Diffusion Posterior Sampling for General Noisy Inverse Problems"


MotionDiffuse

MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model


ReMoDiffuse

ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model


ComfyUI-MotionDiff

Implementation of MDM, MotionDiffuse and ReMoDiffuse into ComfyUI


attention-couple-ComfyUI

ComfyUI custom node for Attention Couple


EAI-Math-Reading-Group

Resources from the EleutherAI Math Reading Group


low-bit-optimizers

Low-bit optimizers for PyTorch


A repository for research on medium sized language models.


GodMode

AI Chat Browser: Fast, Full webapp access to ChatGPT / Claude / Bard / Bing / Llama2! I use this 20 times a day.


ai-town

A MIT-licensed, deployable starter kit for building and customizing your own version of AI town - a virtual town where AI characters live, chat and socialize.


lida

Automatic Generation of Visualizations and Infographics using Large Language Models


prompt2model - Generate Deployable Models from Natural Language Instructions


open-interpreter

A natural language interface for computers


AgentVerse

🤖 AgentVerse 🪐 is designed to facilitate the deployment of multiple LLM-based agents in various applications, which primarily provides two frameworks: task-solving and simulation


OpenPipe

Turn expensive prompts into cheap fine-tuned models


tldraw

Infinite canvas.


ToRA

ToRA is a series of Tool-integrated Reasoning LLM Agents designed to solve challenging mathematical reasoning problems by interacting with tools [ICLR'24].


genai-stack

Langchain + Docker + Neo4j + Ollama


lobe-chat

🤯 Lobe Chat - an open-source, modern-design ChatGPT/LLMs UI/Framework. Supports speech-synthesis, multi-modal, and extensible plugin system. One-click FREE deployment of your private ChatGPT/Gemini/Ollama chat application.


kani

kani (カニ) is a highly hackable microframework for chat-based language models with tool use/function calling. (NLP-OSS @ EMNLP 2023)


XAgent

An Autonomous LLM Agent for Complex Task Solving


Adala

Adala: Autonomous DAta (Labeling) Agent framework


Chain-of-ThoughtsPapers

A trend starts from "Chain of Thought Prompting Elicits Reasoning in Large Language Models".


Discord-Scrapers

Implementation of a discord channel scraper to generate datasets.


parallel-disk-usage

Highly parallelized, blazing fast directory tree analyzer


SEINE

[ICLR 2024] SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Prediction


InSPyReNet

Official PyTorch implementation of Revisiting Image Pyramid Structure for High Resolution Salient Object Detection (ACCV 2022)


PeRF

[Technical Report 2023] PERF: Panoramic Neural Radiance Field from a Single Panorama


Various transformers for FSDP research


Curated list of papers and resources focused on 3D Gaussian Splatting, intended to keep pace with the anticipated surge of research in the coming months.


Instant-angelo

Instant-angelo: Build high-fidelity Digital Twin within 20 Minutes!


metal-splats

Toy iOS + Metal AR Gaussian Splat Renderer


Source code to pbrt, the ray tracer described in the forthcoming 4th edition of the "Physically Based Rendering: From Theory to Implementation" book.


lost-in-the-middle

Code and data for "Lost in the Middle: How Language Models Use Long Contexts"


distil-whisper

Distilled variant of Whisper for speech recognition. 6x faster, 50% smaller, within 1% word error rate.


candle-cookbook

Cookbook to build Rust Candle models


InstructEdit

Implementation of InstructEdit


MoVQGAN

MoVQGAN - model for the image encoding and reconstruction


fipt

FIPT: Factorized Inverse Path Tracing


kinference

Running ONNX models in vanilla Kotlin


Real-Time-Latent-Consistency-Model

Demo showcasing ~real-time Latent Consistency Model pipeline with Diffusers and a MJPEG stream server


parquet-wasm

Rust-based WebAssembly bindings to read and write Apache Parquet data


comfyui-prompt-reader-node

The ultimate solution for managing image metadata and multi-tool compatibility. ComfyUI node version of the SD Prompt Reader


4D Gaussian Splatting for Real-Time Dynamic Scene Rendering


VALSE

Data repository for the VALSE benchmark.


prodigy

The Prodigy optimizer and its variants for training neural networks.


utilities for decoding deep representations (like sentence embeddings) back to text


Obsidian

Maybe the new state of the art vision model? we'll see 🤷♂


jlrs

Julia bindings for Rust


dasher

Read-only mirror of https://gitlab.gnome.org/GNOME/dasher


nctpy

A toolbox for implementing Network Control Theory analyses in python


convert-colors-py

A Python package for converting colors between different color spaces.


deepface

A Lightweight Face Recognition and Facial Attribute Analysis (Age, Gender, Emotion and Race) Library for Python


video-generation-survey

A reading list of video generation


q-diffusion

[ICCV 2023] Q-Diffusion: Quantizing Diffusion Models.


BK-SDM

A Compressed Stable Diffusion for Efficient Text-to-Image Generation [ICCV'23 Demo] [ICML'23 Workshop]


marimo

A reactive notebook for Python — run reproducible experiments, execute as a script, deploy as an app, and version with git.


secure-python-package-template

Template for a Python package with a secure project host and package repository configuration.


GaussianDreamer

GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Models


VectorFusion-pytorch

[CVPR 2023]  Unofficial implementation for "VectorFusion: Text-to-SVG by Abstracting Pixel-Based Diffusion Models"


DiffSketcher

[NIPS 2023]  Official implementation for "DiffSketcher: Text Guided Vector Sketch Synthesis through Latent Diffusion Models" https://arxiv.org/abs/2306.14685


Awesome-Video-Diffusion

A curated list of recent diffusion models for video generation, editing, restoration, understanding, etc.


AVeryComfyNerd

ComfyUI related stuff and things


piper

A fast, local neural text to speech system


tensor-sensor

The goal of this library is to generate more helpful exception messages for matrix algebra expressions for numpy, pytorch, jax, tensorflow, keras, fastai.


TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.


4K4D: Real-Time 4D View Synthesis at 4K Resolution


DreamSpace

DreamSpace: Dreaming Your Room Space with Text-Driven Panoramic Texture Propagation


OpenAgents

OpenAgents: An Open Platform for Language Agents in the Wild


ComfyUI-LCM

Latent Consistency Model for ComfyUI


sd-webui-lcm

Latent Consistency Model for AUTOMATIC1111 Stable Diffusion WebUI


calibrated-posterior

Calibrating Neural Simulation-Based Inference with Differentiable Coverage Probability


outdated

Check if a version of a PyPI package is outdated


approxcdf

(Python, R, C) Fast approximations for the CDF of multivariate normal distributions


fastsdcpu

Fast stable diffusion on CPU


cytoscape.js

Graph theory (network) library for visualisation and analysis


latent-consistency-model

Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference


Arithmo

Small and Efficient Mathematical Reasoning LLMs


Eureka

Official Repository for "Eureka: Human-Level Reward Design via Coding Large Language Models"


srf-attention

Simplex Random Feature attention, in PyTorch


model-soups

Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time


caption-upsampling

This repository implements the idea of "caption upsampling" from DALL-E 3 with Zephyr-7B and gathers results with SDXL.


gephi

Gephi - The Open Graph Viz Platform


deck.gl

WebGL2 powered visualization framework


sigma.js

A JavaScript library aimed at visualizing graphs of thousands of nodes and edges


observable-jupyter

Embed visualizations and code from Observable notebooks in Jupyter


zadu

A Python Library for Evaluating the Reliability of Dimensionality Reduction Embeddings


comparative-embedding-visualization

A Jupyter widget for comparing two embeddings with shared labels by their confusion, neighborhoods, and size.


wizmap

Explore and interpret large embeddings in your browser with interactive visualization! 📍


pygraphistry

PyGraphistry is a Python library to quickly load, shape, embed, and explore big graphs with the GPU-accelerated Graphistry visual graph analyzer


ComfyUI-Custom-Scripts

Enhancements & experiments for ComfyUI, mostly focusing on UI features


Adds a feature to ComfyUI that lets you nest nodes under a new node for better organization and simplification of repetitive patterns in workflows.


SREDS

Skin Reflectance Estimate Based on Dichromatic Separation (SREDS)


appwrite

Build like a team of hundreds_


krita-ai-diffusion

Streamlined interface for generating images with AI in Krita. Inpaint and outpaint with optional text prompt, no tweaking required.


Make AI art between canvas and nodes with Krita.


CushyStudio

🛋 The AI and Generative Art platform for everyone


Official implementation of the paper "The Stable Signature Rooting Watermarks in Latent Diffusion Models"


Forward-Forward

Reimplementation of Geoffrey Hinton's Forward-Forward Algorithm


codellama

Inference code for CodeLlama models


SoundStorm

The reproduced code for Google's SoundStorm


Hotshot-XL

✨ Hotshot-XL: State-of-the-art AI text-to-GIF model trained to work alongside Stable Diffusion XL


juicefs

JuiceFS is a distributed POSIX file system built on top of Redis and S3.


cookiecutter-pypackage

Cookiecutter template for a Python package.


Stable-Diffusion-Webui-Civitai-Helper

Stable Diffusion Webui Extension for Civitai, to manage your model much more easily.


lantern

PostgreSQL vector database extension for building AI applications


disent

🧶 Modular VAE disentanglement framework for python built with PyTorch Lightning ▸ Including metrics and datasets ▸ With strongly supervised, weakly supervised and unsupervised methods ▸ Easily configured and run with Hydra config ▸ Inspired by disentanglement_lib


distroless

🥑  Language focused docker images, minus the operating system.


MVDream

Multi-view Diffusion for 3D Generation


MVDream-threestudio

3D generation code for MVDream


Llama 2 Everywhere (L2E)


bayesian-flow-networks

This is the official code release for Bayesian Flow Networks.


streaming-llm

[ICLR 2024] Efficient Streaming Language Models with Attention Sinks


spack

A flexible package manager that supports multiple versions, configurations, platforms, and compilers.


WebGL-Fluid-Simulation

Play with fluids in your browser (works even on mobile)


Custom Nodes for Comfyui


BlackSheep

Fast ASGI web framework for Python


fastargs

Python library for argument and configuration management


sqlite-vss

A SQLite extension for efficient vector search, based on Faiss!


concept-graphs

Official code release for ConceptGraphs


dreamgaussian

Generative Gaussian Splatting for Efficient 3D Content Creation


Tinytorch

A really tiny autograd engine


DeRy

[NeurIPS2022] Deep Model Reassembly


vapoursynth

A video processing framework with simplicity in mind


AI generated UI components


PGDiff

[NeurIPS 2023] PGDiff: Guiding Diffusion Models for Versatile Face Restoration via Partial Guidance


FocalsConv

Focal Sparse Convolutional Networks for 3D Object Detection (CVPR 2022, Oral)


FLEX

Code for our CVPR'23 paper - "FLEX: Full-Body Grasping Without Full-Body Grasps"


anthropic-cookbook

A collection of notebooks/recipes showcasing some fun and effective ways of using Claude.


llm-ls

LSP server leveraging LLMs for code completion (and more?)


no-more-secrets

A command line tool that recreates the famous data decryption effect seen in the 1992 movie Sneakers.


MLOPs

Machine Learning Toolset for Houdini


Segment Anything in 3D with NeRFs (NeurIPS 2023)


DreamLLM

DreamLLM: Synergistic Multimodal Comprehension and Creation


silo-lm

SILO Language Models code repository


DALM

Domain Adapted Language Modeling Toolkit - E2E RAG


raft

RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.


RectifiedFlow

Official Implementation of Rectified Flow (ICLR2023 Spotlight)


PyTorch implementation of the mixture distribution family with implicit reparametrisation gradients.


private-detector

Bumble's Private Detector - a pretrained model for detecting lewd images


LongLoRA

Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)


mteb

MTEB: Massive Text Embedding Benchmark


Animation oriented nodes pack for ComfyUI


objaverse-xl

🪐 Objaverse-XL is a Universe of 10M+ 3D Objects. Contains API Scripts for Downloading and Processing!


FreeU

FreeU: Free Lunch in Diffusion U-Net


General Speech Restoration


SelfRemaster: SSL Speech Restoration


gitwit-agent

Create repos and commits with AI.


A selection of nodes for Stable Diffusion ComfyUI


FreeU - Free Lunch, and Dinner.


sd-webui-freeu

a1111 implementation of https://github.com/ChenyangSi/FreeU


torch-dist-utils

Utilities for PyTorch distributed


hydrus

A personal booru-style media tagger that can import files and tags from your hard drive and popular websites. Content can be shared with other users via user-run servers.


disentangling-correlated-factors

A benchmarking suite for disentanglement algorithms, suited for evaluating robustness to correlated factors. Codebase for the paper "Disentanglement of Correlated Factors via Hausdorff Factorized Support" by Karsten Roth, Mark Ibrahim, Zeynep Akata, Pascal Vincent, Diane Bouchacourt.


sandstorm

Sandstorm is a self-hostable web productivity suite. It's implemented as a security-hardened web app package manager.


Mastering Diverse Domains through World Models


RT-DETR

Official RT-DETR (RTDETR paddle pytorch), Real-Time DEtection TRansformer, DETRs Beat YOLOs on Real-time Object Detection. 🔥 🔥 🔥


MIC

MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU


LLM-Agent-Paper-List

The paper list of the 86-page paper "The Rise and Potential of Large Language Model Based Agents: A Survey" by Zhiheng Xi et al.


SFHQ-dataset

Synthetic Faces High Quality (SFHQ) Dataset. 425,000 curated 1024x1024 synthetic face images


HyperKohaku

A diffusers based implementation of HyperDreamBooth


Inference Llama 2 in one file of pure 🔥


sd-civitai-browser-plus

Extension to access CivitAI via WebUI: download, delete, scan for updates, list installed models, assign tags, and boost downloads with multi-threading.


agents

An Open-source Framework for Autonomous Language Agents


MBW

This work generates 2D and 3D landmark labels from videos with only two or three uncalibrated, handheld cameras moving in the wild. NeurIPS 2022.


Website source code for our ACM MM'23 paper "Hierarchical Masked 3D Diffusion Model for Video Outpainting".


NExT-GPT

Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model


efficientvit

EfficientViT is a new family of vision models for efficient high-resolution vision.


simple-diffusion

A minimal implementation of a denoising diffusion model in PyTorch.


MDT

Masked Diffusion Transformer is the SOTA for image synthesis. (ICCV 2023)


AutoAWQ

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:


Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.


DQTrack

Official PyTorch implementation of End-to-end 3D Tracking with Decoupled Queries [ICCV 2023]


DWPose

"Effective Whole-body Pose Estimation with Two-stages Distillation" (ICCV 2023, CV4Metaverse Workshop)


oxipng

Multithreaded PNG optimizer written in Rust


[SIGGRAPH Asia 2023] Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation


Versatile audio super resolution (any -> 48kHz) with AudioSR.


CleanUNet

Official PyTorch Implementation of CleanUNet (ICASSP 2022)


DiffTF

Official PyTorch implementation of DiffTF (Accepted by ICLR2024)


ST-MFNet

[IEEE/CVF CVPR'2022] "ST-MFNet: A Spatio-Temporal Multi-Flow Network for Frame Interpolation", Duolikun Danier, Fan Zhang, David Bull


SAFMN

[ICCV 2023] Spatially-Adaptive Feature Modulation for Efficient Image Super-Resolution; runner-up method for the model complexity track in NTIRE2023 Efficient SR challenge


nanosam

A distilled Segment Anything (SAM) model capable of running real-time with NVIDIA TensorRT


torch-bakedsdf

An unofficial pytorch implementation of BakedSDF


MAmmoTH

This repo contains the code and data for "MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuning"


break-a-scene

Official implementation for "Break-A-Scene: Extracting Multiple Concepts from a Single Image" [SIGGRAPH Asia 2023]


Multipack distributed sampler for fast padding-free training of LLMs


LoFTR

Code for "LoFTR: Detector-Free Local Feature Matching with Transformers", CVPR 2021, T-PAMI 2022


DELTA

Learning Disentangled Avatars with Hybrid 3D Representations. (Face, Body, Hair and Clothing)


PoseDiffusion

[ICCV 2023] PoseDiffusion: Solving Pose Estimation via Diffusion-aided Bundle Adjustment


ModuleFormer

ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward experts. We released a collection of ModuleFormer-based Language Models (MoLM) ranging in scale from 4 billion to 8 billion parameters.


InstaFlow

:zap: InstaFlow! One-Step Stable Diffusion with Rectified Flow


candle-lora

Low rank adaptation (LoRA) for Candle.


MotionGPT

[NeurIPS 2023] MotionGPT: Human Motion as a Foreign Language, a unified motion-language generation model using LLMs


ResShift

ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shifting (NeurIPS 2023 Spotlight)


DoLa

Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"


JAX-Toolbox

JAX-Toolbox


HyperDiffusion

Official code repository of "HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusion" @ ICCV 2023


splat

WebGL 3D Gaussian Splat Viewer


Medusa

Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads


DetectorFreeSfM

Code for "Detector-Free Structure from Motion", Arxiv Preprint


Official Repository for the 3DV 2022 paper "The 8-Point Algorithm as an Inductive Bias for Relative Pose Prediction by ViTs"


disco

A Toolkit for Distributional Control of Generative Models


airoboros

Customizable implementation of the self-instruct paper.


blended-tiling

A seamless / blended tiling module for PyTorch, capable of blending any 4D NCHW tensors together


rtabmap

RTAB-Map library and standalone application


datasets

🎁  5,400,000+ Unsplash images made available for research and machine learning


FQSE

Fully Quantized Neural Networks For Speech Enhancement


whisper-turbo

Cross-Platform, GPU Accelerated Whisper 🏎


A fast inference library for running LLMs locally on modern consumer-class GPUs


InstructDiffusion

PyTorch implementation of InstructDiffusion, a unifying and generic framework for aligning computer vision tasks with human instructions.


ReuseAndDiffuse

Reuse and Diffuse: Iterative Denoising for Text-to-Video Generation


Tracking-Anything-with-DEVA

[ICCV 2023] Tracking Anything with Decoupled Video Segmentation


ProPainter

[ICCV 2023] ProPainter: Improving Propagation and Transformer for Video Inpainting


AIScripts

Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub


DDColor

[ICCV 2023] Official implementation of "DDColor: Towards Photo-Realistic Image Colorization via Dual Decoders"


ComfyUI-SD-Workflows

Workflows I use to make AI Art in Stable Diffusion with ComfyUI


kuberay

A toolkit to run Ray applications on Kubernetes


ipyblender-experimental

Blender in Jupyter.


Official pytorch implementation of the paper: "An Edit Friendly DDPM Noise Space: Inversion and Manipulations"


ResFields

[ICLR 2024 Spotlight] ResFields: Residual Neural Fields for Spatiotemporal Signals


TokenMixer

An A1111 extension for interpolating tokens into embeddings


cola

Compositional Linear Algebra


ReliTalk

[IJCV 2024] Code for ReliTalk


DITN

Unfolding Once is Enough: A Deployment-Friendly Transformer Unit for Super-Resolution


SyncDreamer

[ICLR2024] SyncDreamer: Generating Multiview-consistent Images from a Single-view Image


ggml-python

Python bindings for ggml


DiffusionLLM

Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"


old-github-feed

Brings back GitHub's old feed


github-feed-back

Bring my GitHub feed back


kitty

Cross-platform, fast, feature-rich, GPU based terminal


TokenFlow

Official Pytorch Implementation for "TokenFlow: Consistent Diffusion Features for Consistent Video Editing" presenting "TokenFlow" (ICLR 2024)


comet-llm

Log, Track, and Visualize your LLM Prompts and Chains


BLoRA

batched loras


all-in-one

All-In-One Music Structure Analyzer


animatediff

Animatediff implementation. Includes a ControlNet pipeline.


LECO

Low-rank adaptation for Erasing COncepts from diffusion models.


ai-toolkit

Various AI scripts. Mostly Stable Diffusion stuff.


LLaSM

第一个支持中英文双语语音-文本多模态对话的开源可商用对话模型。便捷的语音输入将大幅改善以文本为输入的大模型的使用体验，同时避免了基于 ASR 解决方案的繁琐流程以及可能引入的错误。


PyTorch implementation of HashedNets


SportsSloMo

SportsSloMo: A New Benchmark and Baseline Models for Human-centric Video Frame Interpolation (https://arxiv.org/abs/2308.16876)


yarn

YaRN: Efficient Context Window Extension of Large Language Models


modular-diffusion

Python library for designing and training your own Diffusion Models with PyTorch.


[AAAI'2024] IT3D: Improved Text-to-3D Generation with Explicit View Synthesis


Stable-Diffusion-Latent-Space-Explorer

Codebase for performing various experiments with Stable Diffusion, supported by the diffusers library.


ComfyUI-Inspire-Pack

This repository offers various extension nodes for ComfyUI. Nodes here have different characteristics compared to those in the ComfyUI Impact Pack. The Impact Pack has become too large now...


xtuner

An efficient, flexible and full-featured toolkit for fine-tuning large models (InternLM, Llama, Baichuan, Qwen, ChatGLM)


PointLLM

[arXiv 2023] PointLLM: Empowering Large Language Models to Understand Point Clouds


Streaming-Video-Model

[CVPR2023] Code for "Streaming Video Model"


viewset-diffusion

Implementation of `Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Data' (ICCV 2023)


roop-unleashed

Evolved Fork of roop with Web Server and lots of additions


AdaLoRA

AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).


GPTQ-triton

GPTQ inference Triton kernel


VocalForge

Your one-stop solution for voice dataset creation


rpyc

RPyC (Remote Python Call) - A transparent and symmetric RPC library for python


RemFx

General Purpose Audio Effect Removal


GLAMR

[CVPR 2022 Oral] Official PyTorch Implementation of "GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Cameras”.


ChatDev

Create Customized Software using Natural Language Idea (through LLM-powered Multi-Agent Collaboration)


Low rank adaptation for segmentation anything model (SAM)


udocker

A basic user tool to execute simple docker containers in batch or interactive systems without root privileges.


ai-jsx

The AI Application Framework for Javascript


gpt-pilot

Dev tool that writes scalable apps from scratch while the developer oversees the implementation


DiffBIR

Official codes of DiffBIR: Towards Blind Image Restoration with Generative Diffusion Prior


semantic

Parsing, analyzing, and comparing source code across many languages


manifesto

The OpenTF Manifesto expresses concern over HashiCorp's switch of the Terraform license from open-source to the Business Source License (BSL) and calls for the tool's return to a truly open-source license.


PyPatchMatch

PatchMatch based image inpainting for C++ and Python.


utterances

:crystal_ball: A lightweight comments widget built on GitHub issues


nutsh

A Platform for Visual Learning from Human Feedback


nebula

A scalable overlay networking tool with a focus on performance, simplicity and security


VALL-E-X

An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io


Foundational Models for State-of-the-Art Speech and Text Translation


magic-avatar

MagicAvatar: Multimodal Avatar Generation and Animation


magic-edit

MagicEdit: High-Fidelity Temporally Coherent Video Editing


DenseDiffusion

Official Pytorch Implementation of DenseDiffusion (ICCV 2023)


sd-webui-regional-prompter

set prompt to divided region


VoxelNeXt

VoxelNeXt: Fully Sparse VoxelNet for 3D Object Detection and Tracking (CVPR 2023)


We extend Segment Anything to 3D perception by combining it with VoxelNeXt.


LocalAI

:robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.


vae-png

An experiment in encapsulating VAE encoded image data in a png file and decoding it back to the original image


VapSR

models and code for "Efficient Image Super Resolution using Vast Receptive Field Attention"


Qwen-VL

The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.


curl-impersonate

curl-impersonate: A special build of curl that can impersonate Chrome & Firefox


cody

AI that knows your entire codebase


photon

A sleek client for Lemmy with powerful mod and admin tools. The only alternative client with feature parity to the official client.


Learning Blind Video Temporal Consistency (ECCV 2018)


ComfyUI-AnimateDiff-Evolved

Improved AnimateDiff for ComfyUI and Advanced Sampling Support


llama-ssp

Experiments on speculative sampling with Llama models


Perlin Power Fractal Noisey Latents for ComfyUI


sd-webui-bmab

Auto masking and inpainting for person, face, hand. Resizing image using detection model.


World

A high-quality speech analysis, manipulation and synthesis system


denoisemoji

command-line tool that allows you to create a pseudo diffusion denoised emoji gif from a PNG/WEBP/JPG image.


EVA

EVA Series: Visual Representation Fantasies from BAAI


animatediff-cli-prompt-travel

animatediff prompt travel


AnimateDiff

AnimationDiff with train


SadTalker

[CVPR 2023] SadTalker：Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation


AD-Evo-Tuner

Motion Module fine tuner for AnimateDiff.


FGVC

[ICCV 2023] Learning Fine-Grained Features for Pixel-wise Video Correspondences


VP-Estimation-with-Prior-Gravity

Vanishing Point Estimation in Uncalibrated Images with Prior Gravity Direction (ICCV 2023)


awesome-adaptive-computation

A curated reading list of research in Adaptive Computation (AC) & Mixture of Experts (MoE).


graph-of-thoughts

Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"


OneDiffusion

OneDiffusion: Run any Stable Diffusion models and fine-tuned weights with ease


Long-Context

This repository contains code and tooling for the Abacus.AI LLM Context Expansion project. Also included are evaluation scripts and benchmark tasks that evaluate a model’s information retrieval capabilities with context expansion. We also include key experimental results and instructions for reproducing and building on them.


Retrieval-based-Voice-Conversion-WebUI

Voice data <= 10 mins can also be used to train a good VC model!


Mangio-RVC-Fork

*CREPE+HYBRID TRAINING* A very experimental fork of the Retrieval-based-Voice-Conversion-WebUI repo that incorporates a variety of other f0 methods, along with a hybrid f0 nanmedian method.


IPAdapter-ComfyUI

experimental


Vox-E

This repo contains the python code as well as the webpage html files for the Vox-E project from VAILab at TAU.


vidcutter

A modern yet simple multi-platform video cutter and joiner.


lossless-cut

The swiss army knife of lossless video/audio editing


sd-webui-negpip

Extension for Stable Diffusion web-ui enables negative prompt in prompt


Official repo of "Guide3D: Create 3D Avatars from Text and Image Guidance"


Matlaber

MATLABER: Material-Aware Text-to-3D via LAtent BRDF auto-EncodeR


sd-webui-cd-tuner

Color/Detail control for Stable Diffusion web-ui


IP-Adapter

The image prompt adapter is designed to enable a pretrained text-to-image diffusion model to generate images with image prompt.


facefusion

Next generation face swapper and enhancer


StableVideo

[ICCV 2023] StableVideo: Text-driven Consistency-aware Diffusion Video Editing


lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.


POPE

Welcome to the project repository for POPE (Promptable Pose Estimation), a state-of-the-art technique for 6-DoF pose estimation of any object in any scene using a single reference.


teenygrad

If tinygrad wasn't small enough for you...


LunarVim

🌙 LunarVim is an IDE layer for Neovim. Completely free and community driven.


Neural-Process-Family

Code for the Neural Processes website and replication of 4 papers on NPs. Pytorch implementation.


tortoise-tts

A multi-voice TTS system trained with an emphasis on quality


ComfyUI-to-Python-Extension

A powerful tool that translates ComfyUI workflows into executable Python code.


VideoBLIP

Supercharged BLIP-2 that can handle videos


VITS-fast-fine-tuning

This repo is a pipeline of VITS finetuning for fast speaker adaptation TTS, and many-to-many voice conversion


llmtools

Finetuning Large Language Models on One Consumer GPU in Under 4 Bits


llama-gpt

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!


linux-remote-desktop

Linux based secure, open source, multi-tenant environment for remote work.


facechain

FaceChain is a deep-learning toolchain for generating your Digital-Twin.


manim-slides

Tool for live presentations using manim


llm-analysis

Latency and Memory Analysis of Transformer Models for Training and Inference


LISA

Project Page for "LISA: Reasoning Segmentation via Large Language Model"


meru

Code for the paper "Hyperbolic Image-Text Representations", Desai et al, ICML 2023


ViPT

[CVPR23] Visual Prompt Multi-Modal Tracking


ComfyUI's ControlNet Auxiliary Preprocessors


BlenderNeuralangelo

Blender addon to inspect and preprocess COLMAP data for Neuralangelo (CVPR 2023)


Wormholes

Official implementation & data for paper "Strong and Precise Modulation of Human Percepts via Robustified ANNs" (NeurIPS 2023)


DeDoDe

[3DV 2024 Oral] DeDoDe 🎶 Detect, Don't Describe --- Describe, Don't Detect, for Local Feature Matching


DRLX

Diffusion Reinforcement Learning Library


ml-fastvit

This repository contains the official implementation of the research paper, "FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterization" ICCV 2023


Bayesian-Flow-Networks

A simple implimentation of Bayesian Flow Networks (BFN)


nerf-from-image

Shape, Pose, and Appearance from a Single Image via Bootstrapped Radiance Field Inversion


ann-benchmarks

Benchmarks of approximate nearest neighbor libraries in Python


This is the official codes for "Level-S2fM: Structure from Motion on Neural Level Set of Implicit Surfaces" accepted as CVPR2023.


neat

Volumetric Wireframe Parsing from Neural Attraction Fields


collage-diffusion

Implementation of Collage Diffusion (https://arxiv.org/abs/2303.00262)


codereview.ai

AI-powered code reviews


pixi

Package management made easy


CoDeF

Official PyTorch implementation of CoDeF: Content Deformation Fields for Temporally Consistent Video Processing


Sketch-a-Sketch

Controlling diffusion-based image generation with just a few strokes


voluptuous

CONTRIBUTIONS ONLY: Voluptuous, despite the name, is a Python data validation library.


face-crop-plus

Face aligner and cropper with quality enhancement and attribute parsing


icrawler

A multi-thread crawler framework with many builtin image crawlers provided.


Avvie

A GTK app for quick image cropping :flower_playing_cards:


page-search

Neural search for web-sites, docs, articles - online!


stable-diffusion.cpp

Stable Diffusion in pure C/C++


PySnooper

Never use print for debugging again


numpy-glm

GL Mathematics for Numpy


perfusion-pytorch

Implementation of Key-Locked Rank One Editing, from Nvidia AI


reloading

Change Python code while it's running without losing state


Fooocus

Focus on prompting and generating


lambdaprompt

λprompt - A functional programming interface for building AI systems


trex

Efficient string matching with regular expressions


hamilton

Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.


deepdataspace

The Go-To Choice for CV Data Visualization, Annotation, and Model Analysis.


dreamGPT

Leverage hallucinations from Large Language Models (LLMs) for novelty-driven explorations.


rusty-graphs

Collection of examples for showcasing various Rust graph data structure libraries.


photon

⚡ Rust/WebAssembly image processing library


aquascope

Interactive visualizations of Rust at compile-time and run-time


sketch

AI code-writing assistant that understands data content


autodistill

Images to inference with no labeling (use foundation models to train supervised models)


mezo-jax

JAX implementation of "Fine-Tuning Language Models with Just Forward Passes"


mixture-of-experts

PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538


chumsky

Write expressive, high-performance parsers with ease.


Transformer-Explainability

[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.


floneum

A toolkit for controllable, private AI on consumer hardware in rust


arguably

The best Python CLI library, arguably.


giskard

🐢 The testing framework for ML models, from tabular to LLMs


rustworkx

A high performance Python graph library implemented in Rust.


phoenix

AI Observability & Evaluation - Evaluate, troubleshoot, and fine tune your LLM, CV, and NLP models in a notebook.


mashumaro

Fast and well tested serialization library


extism

The framework for building with WebAssembly (wasm). Easily load wasm modules, move data, call functions, and build extensible apps.


Time-Series-Library

A Library for Advanced Deep Time Series Models.


kibi

A text editor in ≤1024 lines of code, written in Rust


textdistance.rs

🦀📏 Rust library to compare strings (or any sequences). 25+ algorithms, pure Rust, common interface, Unicode support.


pytorch-OpCounter

Count the MACs / FLOPs of your PyTorch model.


R

An experimental reimagining of R


blender-plots

Python library for making 3D plots with blender


bulletproof-python

A magic-free, understandable python project template using tox, pytest, ruff and pip-tools.


neuralangelo

Official implementation of "Neuralangelo: High-Fidelity Neural Surface Reconstruction" (CVPR 2023)


AnimateDiff

A fork of the Official implementation of AnimateDiff.


Reflected-Diffusion

[ICML 2023] Reflected Diffusion Models (https://arxiv.org/abs/2304.04740)


Platypus

Code for fine-tuning Platypus fam LLMs using LoRA


PUG

This is the repository for the Photorealistic Unreal Graphics (PUG) datasets for representation learning.


Text-To-Video-Finetuning

Finetune ModelScope's Text To Video model using Diffusers 🧨


concept-erasure

Erasing concepts from neural representations with provable guarantees


SIGGRAPH/TOG, 2023: Unsupervised Learning of Robust Spectral Shape Matching


neural-physics-subspaces

Fit low-dimensional subspaces to physical systems with neural networks (SIGGRAPH 2023)


[ICCV 2023] Official implementation of "PODIA-3D: Domain Adaptation of 3D Generative Model Across Large Domain Gap Using Pose-Preserved Text-to-Image Diffusion"


RetroMAE

Codebase for RetroMAE and beyond.


A standard framework for modelling Deep Learning Models for tabular data


Generative Agents: Interactive Simulacra of Human Behavior


ELITE

ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generation (ICCV 2023, Oral)


AudioSep

Official implementation of "Separate Anything You Describe"


async-cuda

Asynchronous CUDA for Rust.


gaoya

Locality Sensitive Hashing


sherpa-ncnn

Real-time speech recognition using next-gen Kaldi with ncnn without Internet connection. Support iOS, Android, Raspberry Pi, VisionFive2, etc.


Lagrangian Neural Networks


osmnx

OSMnx is a Python package to easily download, model, analyze, and visualize street networks and other geospatial features from OpenStreetMap.


cog-sdxl

Stable Diffusion XL training and inference as a cog model


notebooks

misc notebooks i wanted to put in tracking


cypher-for-gremlin

Cypher for Gremlin adds Cypher support to any Gremlin graph database.


video-retalking

[SIGGRAPH Asia 2022] VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild


mindsdb

The platform for building custom AI, enabling smarter organizations.


litestar

Production-ready, Light, Flexible and Extensible ASGI API framework | Effortlessly Build Performant APIs


anomalib

An anomaly detection library comprising state-of-the-art algorithms and features such as experiment management, hyper-parameter optimization, and edge inference.


awesome-ai-devtools

Curated list of AI-powered developer tools.


quivr

Your GenAI Second Brain 🧠  A personal productivity assistant (RAG) ⚡🤖 Chat with your docs (PDF, CSV, ...)  & apps using Langchain, GPT 3.5 / 4 turbo, Private, Anthropic, VertexAI, Ollama, LLMs, that you can share with users !  Local & Private alternative to OpenAI GPTs & ChatGPT powered by retrieval-augmented generation.


chezmoi

Manage your dotfiles across multiple diverse machines, securely.


mentat

Mentat - The AI Coding Assistant


khoj

Your AI second brain. A copilot to search and chat (using RAG) with your knowledge base (pdf, markdown, org). Use powerful, online (e.g gpt4) or private, offline (e.g mistral) LLMs. Self-host locally or have it always accessible on the cloud. Access from Obsidian, Emacs, Desktop app, Web or Whatsapp


danswer

Ask Questions in natural language and get Answers backed by private sources. Connects to tools like Slack, GitHub, Confluence, etc.


Private Q&A and summarization of documents+images or chat with local GPT, 100% private, Apache 2.0. Supports Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://codellama.h2o.ai/


jupyter-ai

A generative AI extension for JupyterLab


SGDiff

Official implementation for "Diffusion-Based Scene Graph to Image Generation with Masked Contrastive Pre-Training" https://arxiv.org/abs/2211.11138


openOutpaint-webUI-extension

direct A1111 webUI extension for openOutpaint


ViCo

Official PyTorch codes for the paper: "ViCo: Detail-Preserving Visual Condition for Personalized Text-to-Image Generation"


ProSpect

Official implementation of the paper "ProSpect: Prompt Spectrum for Attribute-Aware Personalization of Diffusion Models"(SIGGRAPH Asia 2023)


FateZero

[ICCV 2023 Oral] "FateZero: Fusing Attentions for Zero-shot Text-based Video Editing"


images-grid-comfy-plugin

A simple comfyUI plugin for images grid (X/Y Plot)


ComfyUI node that let you pick the way in which prompt weights are interpreted


masquerade-nodes-comfyui

A powerful set of mask-related nodes for ComfyUI


Tiled samplers for ComfyUI


6 nodes for ComfyUI that allows for more control and flexibility over noise to do e.g. variations or "un-sampling"


Utility nodes for ComfyUI


lleaves

Compiler for LightGBM gradient-boosted trees, based on LLVM. Speeds up prediction by ≥10x.


A SDXL compatible T2I-adapter implementation using Diffusers including a training script


streamlink

Streamlink is a CLI utility which pipes video streams from various services into a video player


pyobsplot

Observable Plot in Jupyter notebooks and Quarto documents


continue

⏩ The easiest way to code with any LLM—Continue is an open-source autopilot for VS Code and JetBrains


ollama

Get up and running with Llama 2, Mistral, Gemma, and other large language models.


torchhd

Torchhd is a Python library for Hyperdimensional Computing and Vector Symbolic Architectures


python-osc

Open Sound Control server and client in pure python


minSDXL

Huggingface-compatible SDXL Unet implementation that is readily hackable


scope-rl

SCOPE-RL: A python library for offline reinforcement learning, off-policy evaluation, and selection


comfyui-animatediff

AnimateDiff for ComfyUI


Text-to-Audio/Music Generation


Inference Llama 2 in one file of pure Rust 🦀


Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust


MiniChain

A tiny library for coding with large language models.


pgvecto.rs

Scalable, Low-latency and Hybrid-enabled Vector Search in Postgres. Revolutionize Vector Search, not Database.


MetaGPT

🌟 The Multi-Agent Framework: Given one line Requirement, return PRD, Design, Tasks, Repo


stable-diffusion-burn

Stable Diffusion v1.4 ported to Rust's burn framework


AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.


Like ChatGPT's voice conversations with an AI, but entirely offline/private/trade-secret-friendly, using local AI models such as LLama 2 and Whisper


trimesh

Python library for loading and using triangular meshes.


shapely

Manipulation and analysis of geometric objects


ToolBench

[ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.


awesome-information-geometry

About A collection of AWESOME things about information geometry Topics


4DHumans: Reconstructing and Tracking Humans with Transformers


PHALP

Code repository for the paper "Tracking People by Predicting 3D Appearance, Location & Pose". (CVPR 2022 Oral)


ConceptLab

Official Implementation for "ConceptLab: Creative Generation using Diffusion Prior Constraints"


LDLM

Latent Diffusion Language Models


diffengine

Diffusers training with mmengine


conditional-flow-matching

TorchCFM: a Conditional Flow Matching library


dgm-eval

Codebase for evaluation of deep generative models as presented in Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion models


zeno-build

Build, evaluate, understand, and fix LLM-based apps


lightllm

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.


CLBlast

Tuned OpenCL BLAS


HumanArt

[CVPR 2023] The official implementation of CVPR 2023 paper "Human-Art: A Versatile Human-Centric Dataset Bridging Natural and Artificial Scenes"


An Open-source Toolkit for LLM Development


NeRD-Neural-Reflectance-Decomposition

NeRD: Neural Reflectance Decomposition from Image Collections - ICCV 2021


co-tracker

CoTracker is a model for tracking any point (pixel) on a video.


photoswap

Official implementation of the NeurIPS 2023 paper "Photoswap: Personalized Subject Swapping in Images"


tensorrt-rs

Rust library for running TensorRT accelerated deep learning models


Official PyTorch Implementation of Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors (ICLR24)


SRFormer

Official code for "SRFormer: Permuted Self-Attention for Single Image Super-Resolution" (ICCV 2023)


Hierarchical Navigable Small World (HNSW) algorithm for vector similarity search in PostgreSQL


TurboNeRF

A render engine for NeRFs!


blibla-comfyui-extensions

Extensions for ComfyUI


distill-sd

Segmind Distilled diffusion


lorahub

The official repository of paper "LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition".


ComfyBox

Customizable Stable Diffusion frontend for ComfyUI


ComfyUI-Workflow-Component

This is a side project to experiment with using workflows as components.


wyrde-comfyui-workflows

some wyrde workflows for comfyUI


renpy

The Ren'Py Visual Novel Engine


Styles-Editor

Simple editor for styles in Automatic1111


pinokio

AI Browser


The official implementation of the paper Seal-3D: Interactive Pixel-Level Editing for Neural Radiance Fields, the first interactive pixel-level NeRF editing tool.


A fast llama2 decoder in pure Rust.


gpm

Official implementation of the paper "Unifying GANs and Score-Based Diffusion as Generative Particle Models", NeurIPS 2023


QuIP

Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees"


Text2Cinemagraph: Text-Guided Synthesis of Eulerian Cinemagraphs [SIGGRAPH ASIA 2023]


rayon

Rayon: A data parallelism library for Rust


KnowLM

An Open-sourced Knowledgable Large Language Model Framework.


EasyEdit

An Easy-to-use Knowledge Editing Framework for LLMs.


Code Repository for Liquid Time-Constant Networks (LTCs)


sweep

Sweep: AI-powered Junior Developer for small features and bug fixes.


donut

Official Implementation of OCR-free Document Understanding Transformer (Donut) and Synthetic Document Generator (SynthDoG), ECCV 2022


pinokiod

Backend for https://github.com/pinokiocomputer/pinokio


This script is to test your prompts with the AUTOMATIC1111 webui


sd-lazy-wildcards

sd-webui wildcards filled by LLM, no wordlist files required


metal-spatial-rendering

A minimal example of rendering a fully immersive spatial experience with Metal, ARKit, and visionOS Compositing Services


candle

Minimalist ML framework for Rust


taesd

Tiny AutoEncoder for Stable Diffusion


fast-stable-diffusion

fast-stable-diffusion + DreamBooth


official code of "One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization"


NoTrainNoGain

Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)