matatonic's picture

22 29

matatonic

matatonic

·

matatonic

AI & ML interests

None yet

Recent Activity

new activity about 23 hours ago

YiXin-AILab/YiXin-Distill-Qwen-72B:Can you quantify exl2 4.5bpw of this model?

updated a model 2 days ago

matatonic/OlympicCoder-32B-6.5bpw-h8-exl2

published a model 2 days ago

matatonic/OlympicCoder-32B-6.5bpw-h8-exl2

View all activity

Organizations

None yet

matatonic's activity

New activity in YiXin-AILab/YiXin-Distill-Qwen-72B about 23 hours ago

Can you quantify exl2 4.5bpw of this model?

#1 opened 1 day ago by

New activity in matatonic/r1-1776-distill-llama-70b-abliterated-6.5bpw-h8-exl2 12 days ago

Can you train this model for 4.5bpw quantization?

#1 opened 13 days ago by

New activity in matatonic/Qwen2.5-72B-Instruct-abliterated-v2-6.5bpw-h8-exl2 13 days ago

Can you produce a 4.5bpw quantized model of this model?

#1 opened 14 days ago by

New activity in matatonic/r1-1776-distill-llama-70b-6.5bpw-h8-exl2 20 days ago

Running 1776 with draft model

#1 opened 20 days ago by

New activity in AIDC-AI/Ovis1.6-Llama3.2-3B-GPTQ-Int4 3 months ago

Rename gptq_model-4bit-128g.safetensors to model.safetensors

#1 opened 3 months ago by

New activity in AIDC-AI/Ovis1.6-Gemma2-9B-GPTQ-Int4 3 months ago

Rename gptq_model-4bit-128g.safetensors to model.safetensors

#7 opened 3 months ago by

New activity in fancyfeast/llama-joycaption-alpha-two-hf-llava 5 months ago

Support added to openedai-vision

#2 opened 5 months ago by

New activity in cyan2k/molmo-7B-D-bnb-4bit 6 months ago

Updated models no longer require tensorflow

#5 opened 6 months ago by

conversion script please

#2 opened 6 months ago by

ctranslate2-4you

New activity in Qwen/Qwen2-VL-7B-Instruct-AWQ 6 months ago

config.json breaking change?

#4 opened 6 months ago by

New activity in mx262/MiniMonkey 6 months ago

MiniMokney - typo?

#1 opened 6 months ago by

New activity in drbaph/FLUX.1-schnell-dev-merged-fp8-4step 6 months ago

float8_e5m2 weights?

#4 opened 6 months ago by

New activity in internlm/internlm-xcomposer2d5-7b 8 months ago

xcomposer2d5 3rd party sft support

#12 opened 8 months ago by

New activity in OpenGVLab/InternVL-Chat-V1-5-AWQ 10 months ago

How to load without lmdeploy?

#1 opened 10 months ago by

New activity in failspy/Meta-Llama-3-70B-Instruct-abliterated-v3.5 10 months ago

Higher perplexity than Meta-Llama-3-70B-Instruct? Meta-Llama-3-8B-Instruct-abliterated was lower.

#1 opened 10 months ago by

New activity in qihoo360/360VL-70B 10 months ago

Fix invalid quotes in modeling_360vl.py

#1 opened 10 months ago by

New activity in OpenGVLab/InternVL-Chat-V1-5 11 months ago

multi-gpu support?

#9 opened 11 months ago by

FYI: support added to openedai-vision

#8 opened 11 months ago by

New activity in echo840/Monkey 11 months ago

problem loading tokenizer

#4 opened 11 months ago by

New activity in ifmain/moderation-01-Simpest 12 months ago

OpenAI compatible moderations server

#1 opened 12 months ago by