Hugging Face's logo
Adzeiros's picture
23

Adzeiros

Adzeiros

AI & ML interests

None yet

Recent Activity

New activity about 20 hours ago
wolfram/miquliz-120b-v2.0-3.0bpw-h6-exl2
New activity 2 days ago
juvi21/Hermes-2-Theta-L3-Euryale-Ties-0.8-70B
New activity 2 days ago
Envoid/Llama-3.05-Nemotron-Tenyxchat-Storybreaker-70B

Organizations

None yet

Adzeiros's activity

New activity in wolfram/miquliz-120b-v2.0-3.0bpw-h6-exl2 about 20 hours ago

VRAM requirements

9
#1 opened 9 months ago by sophosympatheia
New activity in juvi21/Hermes-2-Theta-L3-Euryale-Ties-0.8-70B 2 days ago

Any chance for EXL2 quants? + SillyTavern settings
#3 opened 2 days ago by Adzeiros
New activity in Envoid/Llama-3.05-Nemotron-Tenyxchat-Storybreaker-70B 2 days ago

SillyTavern Settings
#1 opened 2 days ago by Adzeiros
New activity in Qwen/Qwen2.5-Coder-32B-Instruct 3 days ago

ST Settings
#17 opened 3 days ago by Adzeiros
New activity in async0x42/EVA-Qwen2.5-32B-v0.2-exl2_5.0bpw 3 days ago

Possible 8.0bpw?
#1 opened 3 days ago by Adzeiros
New activity in SicariusSicariiStuff/invisietch_Nimbus-Miqu-v0.1-70B-EXL2-5.5bpw 2 months ago

5.0BPW Quant?

3
#1 opened 3 months ago by Adzeiros
New activity in LoneStriker/Nous-Capybara-34B-8.0bpw-h8-exl2 3 months ago

Needs "trust-remote-code" ?
#1 opened 3 months ago by Adzeiros
New activity in invisietch/Nimbus-Miqu-v0.1-70B 3 months ago

EXL2 Quants

2
#2 opened 3 months ago by Adzeiros
New activity in lucyknada/CohereForAI_c4ai-command-r-08-2024-exl2 3 months ago

8.0bpw quant?

3
#1 opened 3 months ago by Adzeiros
New activity in bartowski/WizardLM-2-8x22B-GGUF 4 months ago

which quaint to I use to fit on a single 24GB video card on a PC Running Windows 11? (4090)

3
#3 opened 5 months ago by clevnumb
New activity in MaziyarPanahi/WizardLM-2-8x22B-GGUF 4 months ago

Help regarding best quantization for below PC specification.

6
#15 opened 7 months ago by bikkikumarsha
New activity in lucyknada/NeverSleep_Lumimaid-v0.2-70B-exl2-5.0bpw 4 months ago

4.0bpw or 4.5bpw

4
#1 opened 4 months ago by Adzeiros
New activity in NeverSleep/Lumimaid-v0.2-123B 4 months ago

EXL2 quants

16
#3 opened 4 months ago by Cytho
New activity in abacusai/Smaug-Llama-3-70B-Instruct-32K 5 months ago

rope_freq_base, should it be at 300000?
#2 opened 5 months ago by Adzeiros
New activity in anthracite-org/magnum-v1-72b 5 months ago

Samplers

4
#6 opened 5 months ago by opendev
New activity in Zoyd/abacusai_Smaug-Llama-3-70B-Instruct-4_0bpw_exl2 5 months ago

Doesn't load?
#1 opened 5 months ago by Adzeiros
New activity in anthracite-org/magnum-v1-72b 5 months ago

GGUF (Q4_K_M only) outputs gibberish

15
#3 opened 5 months ago by Ainonake
New activity in wolfram/miquliz-120b-v2.0 6 months ago

VRAM Estimates

6
#3 opened 9 months ago by ernestr
New activity in LoneStriker/opus-v1.2-llama-3-8b-instruct-run3.5-epoch2.5-8.0bpw-h8-exl2 7 months ago

Is this a quant of the Preview version of DreamGen's Opus v1.2 or the normal one?

1
#1 opened 7 months ago by Adzeiros
New activity in dreamgen/opus-v1.2-llama-3-8b 7 months ago

Context Size Recomendations
#6 opened 7 months ago by Adzeiros