Hugging Face's logo
Mindkrypted's picture
7 1 27

Mindkrypted

mindkrypted
gghfez's profile picture Anthonyg5005's profile picture Kquant03's profile picture
·

AI & ML interests

*.*

Recent Activity

reacted to sr-rai's post with 🤗 about 1 hour ago
ExLlamaV3 is out. And it introduces EXL3 - a new SOTA quantization format! "The conversion process is designed to be simple and efficient and requires only an input model (in HF format) and a target bitrate. By computing Hessians on the fly and thanks to a fused Viterbi kernel, the quantizer can convert a model in a single step, taking a couple of minutes for smaller models, up to a few hours for larger ones (70B+) (on a single RTX 4090 or equivalent GPU.)" Repo: https://github.com/turboderp-org/exllamav3
upvoted a collection about 11 hours ago
EXL3 models
liked a model 18 days ago
cyberdelia/CyberRealisticPony
View all activity

Organizations

Skye Team's profile picture

mindkrypted's activity

upvoted a collection about 11 hours ago