Hugging Face's logo
Sam Vance's picture
20 1 3

Sam Vance

Samvanity

AI & ML interests

None yet

Organizations

None yet

Samvanity's activity

New activity in bartowski/L3-70B-Euryale-v2.1-GGUF 7 days ago

IQ2_XS
#1 opened 7 days ago by Samvanity
New activity in mradermacher/L3-MS-Astoria-70b-i1-GGUF 14 days ago

even smaller quants

1
#1 opened 14 days ago by Samvanity
New activity in bartowski/openchat-3.6-8b-20240522-GGUF 23 days ago

exl2 vs GGUF at 8bit

1
#2 opened 23 days ago by Samvanity
New activity in PrunaAI/Meta-Llama-3-70B-Instruct-GGUF-smashed about 2 months ago

what does smashed mean?

1
#1 opened about 2 months ago by Samvanity
New activity in mgoin/Meta-Llama-3-70B-Instruct-Marlin about 2 months ago

What is Marlin?

2
#1 opened about 2 months ago by Samvanity
New activity in Replete-AI/Llama-3-13B 2 months ago

help me understand the point of such scaling

1
#1 opened 2 months ago by Samvanity
New activity in Kooten/DaringMaid-20B-V1.1 2 months ago

Incredible - the best 20b model I've used

1
#2 opened 2 months ago by Samvanity
New activity in Kquant03/NurseButtercup-4x7B-bf16 2 months ago

Unable to create exl2 quant for this model

1
#1 opened 2 months ago by Samvanity
New activity in bartowski/airoboros-34b-3.2-exl2 4 months ago

Can you make a 4.65 bpw?

5
#1 opened 4 months ago by Samvanity
New activity in Bakanayatsu/NeuralHermes-2.5-Mistral-7B-laser-imatrix-GGUF 4 months ago

what does imatrix do to the model?

1
#1 opened 4 months ago by Samvanity
New activity in ibivibiv/alpaca-dragon-72b-v1 4 months ago

what is the minimum Hardware requirement?

3
#3 opened 4 months ago by Arunmass
New activity in LoneStriker/dolphin-2.7-mixtral-8x7b-3.75bpw-h6-exl2 5 months ago

What calibration dataset did you use to convert it?

1
#1 opened 5 months ago by Samvanity
New activity in second-state/Dolphin-2.7-mixtral-8x7b-GGUF 5 months ago

How is this different from TheBloke's quants?

1
#1 opened 5 months ago by Samvanity
New activity in Kooten/FlatDolphinMaid-8x7B-4bpw-exl2 5 months ago

using context above 4096 - need to set compress_pos_emb above 1?

5
#1 opened 6 months ago by Samvanity
New activity in NeverSleep/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss 5 months ago

Recommended settings?

9
#1 opened 5 months ago by zaq-hack
New activity in LoneStriker/Noromaid-v0.1-mixtral-8x7b-Instruct-v3-4.0bpw-h6-exl2 5 months ago

Noromaid updated to v0.4
#1 opened 5 months ago by Samvanity
New activity in LoneStriker/openchat-3.5-0106-6.0bpw-h6-exl2 5 months ago

Wrong eos_token_id set in config.json

2
#1 opened 5 months ago by Samvanity
New activity in Undi95/Llamix2-MLewd-4x13B 6 months ago

What is the context length of this model?

3
#4 opened 6 months ago by MrHillsss
New activity in Gryphe/MythoMax-L2-13b 7 months ago

Whats the maximum context length for this model?

6
#19 opened 7 months ago by Samvanity