Hugging Face's logo
Adzeiros's picture
25

Adzeiros

Adzeiros

AI & ML interests

None yet

Recent Activity

New activity 5 days ago
bartowski/Qwen2.5-72B-Instruct-exl2:Installing with GIT threw some weird error, and the model wont load with Tabby
New activity 21 days ago
anthracite-org/magnum-v4-123b-exl2:Possibly get a 2.75bpw?
New activity 27 days ago
wolfram/miquliz-120b-v2.0-3.0bpw-h6-exl2:VRAM requirements
View all activity

Organizations

None yet

Adzeiros's activity

New activity in bartowski/Qwen2.5-72B-Instruct-exl2 5 days ago

Installing with GIT threw some weird error, and the model wont load with Tabby
#2 opened 5 days ago by Adzeiros
New activity in anthracite-org/magnum-v4-123b-exl2 21 days ago

Possibly get a 2.75bpw?

1
#2 opened 21 days ago by Adzeiros
New activity in wolfram/miquliz-120b-v2.0-3.0bpw-h6-exl2 27 days ago

VRAM requirements

9
#1 opened 10 months ago by sophosympatheia
New activity in juvi21/Hermes-2-Theta-L3-Euryale-Ties-0.8-70B 28 days ago

Any chance for EXL2 quants? + SillyTavern settings
#3 opened 28 days ago by Adzeiros
New activity in Envoid/Llama-3.05-Nemotron-Tenyxchat-Storybreaker-70B 28 days ago

SillyTavern Settings
#1 opened 28 days ago by Adzeiros
New activity in Qwen/Qwen2.5-Coder-32B-Instruct 29 days ago

ST Settings
#17 opened 29 days ago by Adzeiros
New activity in async0x42/EVA-Qwen2.5-32B-v0.2-exl2_5.0bpw 29 days ago

Possible 8.0bpw?
#1 opened 29 days ago by Adzeiros
New activity in SicariusSicariiStuff/invisietch_Nimbus-Miqu-v0.1-70B-EXL2-5.5bpw 3 months ago

5.0BPW Quant?

3
#1 opened 3 months ago by Adzeiros
New activity in LoneStriker/Nous-Capybara-34B-8.0bpw-h8-exl2 3 months ago

Needs "trust-remote-code" ?
#1 opened 3 months ago by Adzeiros
New activity in invisietch/Nimbus-Miqu-v0.1-70B 4 months ago

EXL2 Quants

2
#2 opened 4 months ago by Adzeiros
New activity in lucyknada/CohereForAI_c4ai-command-r-08-2024-exl2 4 months ago

8.0bpw quant?

3
#1 opened 4 months ago by Adzeiros
New activity in bartowski/WizardLM-2-8x22B-GGUF 4 months ago

which quaint to I use to fit on a single 24GB video card on a PC Running Windows 11? (4090)

3
#3 opened 6 months ago by clevnumb
New activity in MaziyarPanahi/WizardLM-2-8x22B-GGUF 4 months ago

Help regarding best quantization for below PC specification.

6
#15 opened 8 months ago by bikkikumarsha
New activity in lucyknada/NeverSleep_Lumimaid-v0.2-70B-exl2-5.0bpw 5 months ago

4.0bpw or 4.5bpw

4
#1 opened 5 months ago by Adzeiros
New activity in NeverSleep/Lumimaid-v0.2-123B 5 months ago

EXL2 quants

16
#3 opened 5 months ago by Cytho
New activity in abacusai/Smaug-Llama-3-70B-Instruct-32K 6 months ago

rope_freq_base, should it be at 300000?
#2 opened 6 months ago by Adzeiros
New activity in anthracite-org/magnum-v1-72b 6 months ago

Samplers

4
#6 opened 6 months ago by opendev
New activity in Zoyd/abacusai_Smaug-Llama-3-70B-Instruct-4_0bpw_exl2 6 months ago

Doesn't load?
#1 opened 6 months ago by Adzeiros
New activity in anthracite-org/magnum-v1-72b 6 months ago

GGUF (Q4_K_M only) outputs gibberish

15
#3 opened 6 months ago by Ainonake
New activity in wolfram/miquliz-120b-v2.0 7 months ago

VRAM Estimates

6
#3 opened 10 months ago by ernestr