Hugging Face's logo
mobicham's picture
28 5 21

mobicham

mobicham
appoose's profile picture Jilt's profile picture victor's profile picture
·
https://www.mobiuslabs.com/

AI & ML interests

Model pruning, quantization, computer vision, LLMs

Organizations

Mobius Labs GmbH's profile picture Distillation Hugs's profile picture

mobicham's activity

New activity in open-llm-leaderboard/open_llm_leaderboard about 2 months ago

GSM8K (5-shot) performance is quite different compared to running lm_eval locally

5
#755 opened about 2 months ago by mobicham
New activity in mobiuslabsgmbh/Llama-2-7b-chat-hf_1bitgs8_hqq 2 months ago

Details about this model

1
#4 opened 2 months ago by at676
New activity in mobiuslabsgmbh/Llama-2-7b-chat-hf_1bitgs8_hqq 3 months ago

Make it usageable for cpu

1
#3 opened 3 months ago by ar08

Error with adapter ?

2
#2 opened 4 months ago by nelkh
New activity in mobiuslabsgmbh/Llama-2-7b-chat-hf_1bitgs8_hqq 4 months ago

Any plan for making HQQ+ 2bit quant for Mixtral or larger models?

1
#1 opened 4 months ago by raincandy-u
New activity in mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ 4 months ago

Runs out of memory on free tier Google Colab

3
#3 opened 4 months ago by sudhir2016
New activity in mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bitgs8-metaoffload-HQQ 4 months ago

Either README is wrong, or the wrong model file is uploaded?

1
#1 opened 4 months ago by andysalerno
New activity in liuhaotian/llava-v1.6-34b 4 months ago

Quantizations?

2
#1 opened 6 months ago by musicurgy
New activity in mobiuslabsgmbh/aanaphi2-v0.1 4 months ago

Which Dataset ?

1
#4 opened 5 months ago by xxxTEMPESTxxx
New activity in mobiuslabsgmbh/aanaphi2-v0.1 5 months ago

How do I run this on cpu?

5
#3 opened 5 months ago by ARMcPro
New activity in mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ 5 months ago

gguf format

1
#2 opened 5 months ago by GyroO
New activity in mobiuslabsgmbh/aanaphi2-v0.1 5 months ago

Stop overgenerating. Need EOS token?

11
#1 opened 5 months ago by vicplus
New activity in mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ 5 months ago

OSError: mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ does not appear to have a file named pytorch_model.bin, tf_model.h5, model.ckpt or flax_model.msgpack.

1
#1 opened 5 months ago by Tejasram
New activity in open-llm-leaderboard/open_llm_leaderboard 5 months ago

gsm8k score largely different from local run

6
#591 opened 5 months ago by mobicham
New activity in google/siglip-so400m-patch14-384 6 months ago

Output features are different compared to timm

2
#2 opened 6 months ago by mobicham
New activity in lxuechen/phi-2-sft 6 months ago

Can't reproduce the model
#1 opened 6 months ago by mobicham
New activity in mobiuslabsgmbh/Mixtral-8x7B-v0.1-hf-2bit_g16_s128-HQQ 7 months ago

Librarian Bot: Add moe tag to model
#1 opened 7 months ago by librarian-bot
New activity in mobiuslabsgmbh/Mixtral-8x7B-v0.1-hf-attn-4bit-moe-2bit-HQQ 7 months ago

Librarian Bot: Add moe tag to model
#1 opened 7 months ago by librarian-bot
New activity in mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-2bit_g16_s128-HQQ 7 months ago

Librarian Bot: Add moe tag to model
#4 opened 7 months ago by librarian-bot
New activity in mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-HQQ 7 months ago

Librarian Bot: Add moe tag to model
#1 opened 7 months ago by librarian-bot
New activity in mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-4bit_g64-HQQ 7 months ago

Librarian Bot: Add moe tag to model
#4 opened 7 months ago by librarian-bot
New activity in mobiuslabsgmbh/Llama-2-7b-hf-4bit_g64-HQQ 7 months ago

Error in using this model for inference in Google Colab

2
#1 opened 7 months ago by sudhir2016
New activity in mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-4bit_g64-HQQ 7 months ago

Serving with TGI or vLLM?

1
#3 opened 7 months ago by kno10
New activity in mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-2bit_g16_s128-HQQ 7 months ago

New Exciting quant method

2
#3 opened 7 months ago by Yhyu13
New activity in mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-4bit_g64-HQQ 7 months ago

only use one gpu?

2
#2 opened 7 months ago by jgbrblmd
New activity in mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-2bit_g16_s128-HQQ 7 months ago

KeyError: 'mixtral'

1
#2 opened 7 months ago by MohamedBerrimi

How is the performance of the model with 2bits only?

1
#1 opened 7 months ago by DrNicefellow
New activity in mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-4bit_g64-HQQ 7 months ago

persist dequantized model

1
#1 opened 7 months ago by nudelbrot