Hugging Face's logo
Mark Mealman's picture
18 12

Mark Mealman

Dracones
BigHuggyD's profile picture Ryozu's profile picture fakenamington's profile picture
·
mmealman

AI & ML interests

None yet

Organizations

MLX Community's profile picture

Dracones's activity

New activity in NeverSleep/Llama-3-Lumimaid-70B-v0.1 14 days ago

feedback

21
#2 opened 15 days ago by Szarka
New activity in Dracones/WizardLM-2-8x22B_exl2_4.0bpw 29 days ago

3.75 please?

2
#2 opened 30 days ago by jackboot
New activity in Dracones/Midnight-Miqu-70B-v1.5_exl2_3.0bpw about 1 month ago

2.75 bpw high EQ bench

1
#1 opened about 1 month ago by koesn
New activity in Qwen/CodeQwen1.5-7B-Chat about 1 month ago

EXL2 Quants are up

1
#2 opened about 1 month ago by Dracones
New activity in Dracones/WizardLM-2-8x22B_exl2_2.5bpw about 1 month ago

Could you help to create the 3.25bpw model so it can fits on A100?

4
#1 opened about 1 month ago by davideuler
New activity in Dracones/WizardLM-2-8x22B_exl2_4.0bpw about 1 month ago

Can this version be loaded with vllm?

2
#1 opened about 1 month ago by wawoshashi
New activity in fireworks-ai/mixtral-8x22b-instruct-oh about 1 month ago

A good tune
#3 opened about 1 month ago by Dracones
New activity in sophosympatheia/Midnight-Miqu-70B-v1.0 about 1 month ago

Question about prompting and System prompt in Vicuna format

4
#10 opened about 1 month ago by houmie
New activity in Dracones/miqu-1-70b-sf_exl2_2.25bpw about 1 month ago

Update README.md

2
#1 opened about 1 month ago by vvekthkr
New activity in Dracones/Midnight-Miqu-70B-v1.5_exl2_4.0bpw about 2 months ago

Measurments

4
#1 opened 2 months ago by altomek
New activity in miqudev/miqu-1-70b 2 months ago

Any chance anyone is quantizing this into a 2.4bpw EXL2 version for those of us with a single 24GB video cards?

1
#30 opened 2 months ago by clevnumb
New activity in Dracones/Midnight-Miqu-70B-v1.0_exl2_2.24bpw 2 months ago

3.5bpw request

4
#1 opened 2 months ago by Gesard
New activity in Dracones/Midnight-Miqu-103B-v1.0_exl2_4.25bpw 2 months ago

Error

3
#1 opened 2 months ago by Hardcore7651
New activity in sophosympatheia/Midnight-Miqu-103B-v1.0 2 months ago

EXL2 Quants

9
#2 opened 2 months ago by Dracones

GGUF Quants

2
#3 opened 2 months ago by Dracones
New activity in sophosympatheia/Midnight-Miqu-70B-v1.0 2 months ago

5.0 bpw exl2 quant request

4
#2 opened 3 months ago by BeefyRook
New activity in wolfram/miquliz-120b-v2.0-3.0bpw-h6-exl2 3 months ago

VRAM requirements

7
#1 opened 3 months ago by sophosympatheia
New activity in nsfwthrowitaway69/Venus-103b-v1.0 6 months ago

Excellent model

4
#1 opened 6 months ago by Dracones