Hugging Face's logo
Munish Kumar's picture
42 5 507

Munish Kumar

munish0838
dvilasuero's profile picture 21world's profile picture jaxmetaverse's profile picture
·
https://hf.co/QuantFactory

AI & ML interests

LLM Quantizations

Recent Activity

updated a model 1 day ago
munish0838/SmolLM2-FT-MyDataset
liked a model 7 days ago
QuantFactory/granite-3.1-8b-instruct-GGUF
liked a model 7 days ago
QuantFactory/granite-3.1-1b-a400m-base-GGUF
View all activity

Organizations

Open-Source AI Meetup's profile picture Blog-explorers's profile picture Indic Benchmarks's profile picture Quant Factory's profile picture Hugging Face Discord Community's profile picture Dataset Tools's profile picture Data Is Better Together Contributor's profile picture AI Classroom's profile picture

munish0838's activity

New activity in QuantFactory/Ministral-3b-instruct-GGUF 2 months ago

Heads up: this isn't the new ministral 3b

2
#1 opened 2 months ago by
bartowski
New activity in QuantFactory/LLAMA-3_8B_Unaligned_BETA-GGUF 2 months ago

Requesting Re-Quant. Tokenizer Updated with better chatml Support

1
#1 opened 2 months ago by
Luni
New activity in QuantFactory/quant-req 4 months ago

Update app.py
#2 opened 4 months ago by
munish0838
New activity in QuantFactory/Mistral-Nemo-Instruct-2407-GGUF 5 months ago

Error loading model in llama.cpp ?

8
#1 opened 5 months ago by
ubergarm
New activity in QuantFactory/internistai-base-7b-v0.2-GGUF 6 months ago

Add paper and citation
#1 opened 6 months ago by
maximegmd
New activity in munish0838/Gemma2-9b-Matter-0.1-Slim-A 6 months ago

Adding `safetensors` variant of this model
#1 opened 6 months ago by
SFconvertbot
New activity in munish0838/Phi-3-mini-4k-instruct-Matter-0.1-Slim-A 6 months ago

Adding `safetensors` variant of this model
#1 opened 6 months ago by
SFconvertbot
New activity in munish0838/llama-3-8b-Instruct-Matter-0.1-Slim-A 6 months ago

Adding `safetensors` variant of this model
#1 opened 6 months ago by
SFconvertbot
New activity in munish0838/Mistral-v0.3-Instruct-Matter-Slim-A 6 months ago

Adding `safetensors` variant of this model
#1 opened 6 months ago by
SFconvertbot
New activity in instruction-pretrain/medicine-Llama3-8B 6 months ago

Tokenizer files missing

4
#2 opened 6 months ago by
munish0838

Unable to use model

2
#1 opened 6 months ago by
munish0838
New activity in QuantFactory/dolphin-2.9-llama3-8b-GGUF 7 months ago

What am I doing wrong? Using Oobabooga.

3
#1 opened 8 months ago by
Goldenblood56

does not appear to have a file named config.json

2
#2 opened 8 months ago by
atubong
New activity in QuantFactory/Meta-Llama-3-8B-Instruct-GGUF 7 months ago

Compatibility with llama-cpp and Ollama

6
#17 opened 7 months ago by
liashchynskyi
New activity in QuantFactory/Llama-3-Alpha-Ko-8B-Instruct-GGUF 7 months ago

Is the original model allganize/Llama-3-Alpha-Ko-8B-Instruct?

3
#1 opened 7 months ago by
coconut00
New activity in QuantFactory/Phi-3-mini-128k-instruct-GGUF 7 months ago

error when loading the model

5
#3 opened 7 months ago by
StefanStroescu
New activity in mistralai/Codestral-22B-v0.1 7 months ago

How to convert to HF format?

5
#6 opened 7 months ago by
ddh0
New activity in internlm/internlm2-math-plus-1_8b 7 months ago

Rename configuration_internlm.py to configuration_internlm2.py
#1 opened 7 months ago by
munish0838
New activity in internlm/internlm2-math-plus-7b 7 months ago

Rename configuration_internlm.py to configuration_internlm2.py
#1 opened 7 months ago by
munish0838
New activity in QuantFactory/Phi-3-mini-128k-instruct-GGUF 7 months ago

I have now tried two quantizations 8_0, and 6_K, they both fail like you see below.

3
#2 opened 8 months ago by
BigDeeper