Hugging Face's logo
Bartowski's picture
TFLOPS icon 59.7 TFLOPS
269 2 111

Bartowski

bartowski
ParmyJack's profile picture Hugglesworth's profile picture bmxtiger's profile picture
·
bartowski1182
bartowski1182

AI & ML interests

None yet

Organizations

Qwen's profile picture LM Studio's profile picture Arcee AI's profile picture Cognitive Computations's profile picture Crystal Care AI's profile picture LM Studio Community's profile picture private beta for deeplinks's profile picture

bartowski's activity

New activity in bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF about 10 hours ago

EOS token is getting printed

9
#1 opened 1 day ago by migtissera
New activity in mistralai/Mistral-7B-Instruct-v0.3 about 12 hours ago

Please check these quantizations.

1
#40 opened about 12 hours ago by ZeroWw
New activity in bartowski/Samantha-Qwen-2-7B-GGUF 1 day ago

Testing experimental quants

2
#2 opened 1 day ago by bartowski
New activity in bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF 1 day ago

Error loading model

3
#1 opened 1 day ago by smchapman54
New activity in bartowski/gemma-1.1-7b-it-GGUF 1 day ago

How did you convert it?

5
#1 opened 2 days ago by ZeroWw
New activity in bartowski/Samantha-Qwen-2-7B-GGUF 1 day ago

Gibberish output

2
#1 opened 2 days ago by Adriato
New activity in bartowski/Phi-3-medium-128k-instruct-GGUF 2 days ago

Quantization suggestion

24
#3 opened 6 days ago by ZeroWw
New activity in Qwen/Qwen2-0.5B-Instruct-GGUF 4 days ago

-cml / --chatml has been discontinued in llama.cpp

2
#1 opened 12 days ago by algorithm
New activity in Qwen/Qwen1.5-7B-Chat-GGUF 4 days ago

Please post f16 quantization.

3
#1 opened 27 days ago by ZeroWw
New activity in pabloce/Tess-v2.5-Qwen2-72B-gguf 5 days ago

Error when trying to run in OobaBooga

5
#1 opened 5 days ago by AIGUYCONTENT
New activity in Lewdiculous/L3-8B-Stheno-v3.2-GGUF-IQ-Imatrix 5 days ago

BOS token discussion

25
#2 opened 13 days ago by woofwolfy
New activity in bartowski/Tess-v2.5-Qwen2-72B-GGUF 5 days ago

Big jump between IQ2_XXS and IQ2_M - any chance of IQ2_XS quants?

2
#1 opened 5 days ago by smcleod
New activity in SakanaAI/DiscoPOP-zephyr-7b-gemma 5 days ago

Gguf?

4
#1 opened 6 days ago by edwardDali
New activity in bartowski/Qwen2-7B-Instruct-deccp-GGUF 8 days ago

Requant Request

2
#1 opened 8 days ago by leonardlin
New activity in mistralai/Codestral-22B-v0.1 9 days ago

Update config.json

1
#36 opened 10 days ago by rameshjhar480
New activity in bartowski/AutoCoder-GGUF 10 days ago

prompt format and text-gen

8
#1 opened 13 days ago by gandolfi
New activity in bartowski/Qwen2-7B-Instruct-GGUF 11 days ago

blocky blocky blocky

3
#1 opened 12 days ago by mclassHF2023
New activity in bartowski/openchat-3.6-8b-20240522-GGUF 11 days ago

Loading AutoTokenizer and AutoModelForCausalLM

4
#3 opened 12 days ago by nramirezuy
New activity in bartowski/Codestral-22B-v0.1-GGUF 12 days ago

Add base_model

7
#2 opened 14 days ago by julien-c
New activity in bartowski/llama-3-sqlcoder-8b-GGUF 12 days ago

Getting gibberish responses

2
#1 opened 12 days ago by jaycann2
New activity in Qwen/Qwen2-7B-Instruct 12 days ago

bos_token==pad token??

2
#3 opened 12 days ago by Jerry-hyl
New activity in Qwen/Qwen2-7B-Instruct-GGUF 12 days ago

Issue with q8_0

10
#1 opened 12 days ago by smchapman54
New activity in Qwen/Qwen2-1.5B-Instruct 12 days ago

Upload ONNX weights

1
#1 opened 12 days ago by Xenova
New activity in bartowski/L3-TheSpice-8b-v0.8.3-GGUF 13 days ago

Great model. FP16 request

3
#1 opened 13 days ago by Languido
New activity in zero-gpu-explorers/README 13 days ago

DON'T EVEN BOTHER APPLYING - Unofficial ZeroGPU Policy Decoded

43
#69 opened 14 days ago by JosephusCheung
New activity in microsoft/Phi-3-mini-128k-instruct 13 days ago

Good model but Bullshit chart and inaccurate numbers

32
#20 opened about 2 months ago by rombodawg
New activity in bartowski/IceCaffeLatteRP-7b-exl2 15 days ago

Could you make a exl2 quant for the weighted/imatrix version?

3
#1 opened 15 days ago by mjh657
New activity in bartowski/Poppy_Porpoise-1.4-L3-8B-exl2 15 days ago

Normally i would say thank you for quanting.

7
#1 opened 16 days ago by Nitral-AI
New activity in bartowski/Codestral-22B-v0.1-GGUF 15 days ago

Prompt format

9
#1 opened 20 days ago by supportend
New activity in lmstudio-community/aya-23-35B-GGUF 16 days ago

not able to load with llamacpp-python

1
#1 opened 16 days ago by balu548411
New activity in lmstudio-community/Codestral-22B-v0.1-GGUF 19 days ago

"This model also supports the following FIM tokens"

5
#1 opened 19 days ago by catarino
New activity in internlm/AlchemistCoder-CL-7B 19 days ago

pytorch_model files only 33MB?

1
#1 opened 19 days ago by bartowski
New activity in bartowski/Codestral-22B-v0.1-exl2 19 days ago

Update tokenizer to include [SUFFIX] and [PREFIX] tokens?

1
#1 opened 19 days ago by ShiveringSpine
New activity in bartowski/UNA-ThePitbull-21.4B-v2-GGUF 20 days ago

Update README.md

2
#1 opened 20 days ago by fblgit
New activity in bartowski/aya-23-8B-GGUF 21 days ago

Can't load model in LlamaCpp

7
#4 opened 21 days ago by ThoilGoyang
New activity in bartowski/openchat-3.6-8b-20240522-GGUF 21 days ago

exl2 vs GGUF at 8bit

1
#2 opened 21 days ago by Samvanity
New activity in bartowski/Phi-3-medium-128k-instruct-GGUF 21 days ago

Failed to load model cause: "llama.cpp error: 'done_getting_tensors: wrong number of tensors; expected 245, got 243

14
#2 opened 28 days ago by dmeldrum6
New activity in bartowski/Phi-3-medium-4k-instruct-GGUF 22 days ago

On some promts, medium is worse than mini&small?

6
#2 opened 26 days ago by urtuuuu
New activity in bartowski/falcon-11B-GGUF 22 days ago

core dumps when attempting falcon-11B-Q6_K.gguf

1
#1 opened 23 days ago by LaferriereJC
New activity in bartowski/Llama-3-SauerkrautLM-8b-Instruct-GGUF 23 days ago

It seems the quants were created before the BPE pre-tokenizer fix?

1
#1 opened 23 days ago by skruse
New activity in NousResearch/Hermes-2-Theta-Llama-3-8B-GGUF 23 days ago

More quantization variants

11
#1 opened about 1 month ago by Yuma42
New activity in bartowski/openchat-3.6-8b-20240522-GGUF 23 days ago

Promt format question

2
#1 opened 23 days ago by urtuuuu
New activity in openchat/openchat-3.6-8b-20240522 24 days ago

Chat template
#4 opened 24 days ago by bartowski

gguf model

2
#2 opened 25 days ago by edwardDali
New activity in bartowski/aya-23-8B-GGUF 25 days ago

Seems can not use response_format in llama-cpp-python

1
#3 opened 25 days ago by svjack
New activity in bartowski/dolphin-2.9.1-mixtral-1x22b-GGUF 25 days ago

Why does it generate nothing but garbage?

4
#1 opened 25 days ago by newsletter
New activity in bartowski/aya-23-8B-GGUF 25 days ago

Another <EOS_TOKEN> issue

1
#2 opened 25 days ago by alexcardo
New activity in bartowski/gemma-1.1-2b-it-GGUF 25 days ago

Q1 Model

4
#1 opened 26 days ago by neelkalpa
New activity in mistralai/Mistral-7B-v0.1 26 days ago

size of hidden layers and sliding window attention - dimension is the same, 4096. Is that for a reason?

2
#153 opened 26 days ago by keval-sha
New activity in bartowski/granite-20b-code-instruct-GGUF 26 days ago

Update README.md

2
#1 opened 26 days ago by Joseph717171
New activity in mistral-community/mixtral-8x22B-Instruct-v0.3-original 26 days ago

I think this is actually just 0.1

3
#1 opened 26 days ago by bartowski
New activity in bartowski/aya-23-8B-GGUF 26 days ago

LM Studio Error: "llama.cpp error: 'error loading model vocabulary: unknown pre-tokenizer type: 'command-r''"

1
#1 opened 26 days ago by rodion-m
New activity in mistralai/Mistral-7B-Instruct-v0.3 26 days ago

no system message?

8
#14 opened 26 days ago by mclassHF2023
New activity in bartowski/Mistral-7B-Instruct-v0.3-GGUF 26 days ago

v3 tokenizer

5
#1 opened 27 days ago by ayyylol
New activity in Locutusque/Llama-3-Hercules-5.0-8B 28 days ago

Add quant links
#7 opened 28 days ago by bartowski
New activity in bartowski/granite-34b-code-instruct-GGUF 29 days ago

Chat template - use with Ollama?

2
#1 opened 29 days ago by smcleod
New activity in bartowski/HerculeanSea-7b-128k-exl2 29 days ago

Context size?

2
#1 opened 29 days ago by dasChronos1
New activity in jondurbin/airoboros-70b-3.3 29 days ago

GGUF and exl2 quants for anyone who wants

3
#2 opened about 1 month ago by bartowski
New activity in Qwen/Qwen1.5-110B-Chat-demo about 1 month ago

OSError: [Errno 36] File name too long

4
#7 opened about 1 month ago by spoilvoid
New activity in bartowski/Llama-3-8B-Instruct-Gradient-1048k-GGUF about 1 month ago

Only Hallucinates

1
#3 opened about 1 month ago by LaughterOnWater