Robert Sinclair

ZeroWw

AI & ML interests

LLMs optimization (model quantization and back-end optimizations) so that LLMs can run on computers of people with both kidneys. Discord: https://discord.com/channels/@robert_46007

Organizations

ZeroWw's activity

My quants and "silly" experiment.

1
#1 opened about 1 month ago by ZeroWw
New activity in microsoft/Phi-3.5-mini-instruct about 1 month ago

My quants and my "silly" version.

#4 opened about 1 month ago by ZeroWw
New activity in ZeroWw/sounds about 2 months ago
New activity in google/gemma-7b about 2 months ago
New activity in ValiantLabs/Llama3.1-8B-Enigma about 2 months ago

My quants and "silly" experiment.

1
#2 opened about 2 months ago by ZeroWw
New activity in NeverSleep/Lumimaid-v0.2-12B about 2 months ago

My alternate quantizations.

5
#3 opened 2 months ago by ZeroWw
New activity in Writer/Palmyra-Med-70B-32K about 2 months ago
New activity in Intel/neural-chat-7b-v3-3 about 2 months ago
New activity in ZeroWw/codegeex4-all-9b-GGUF about 2 months ago

ZeroWwcodegeex4-all-9b.q6_k not good

1
#2 opened about 2 months ago by ngoquytuan
New activity in TheDrummer/Gemmasutra-Mini-2B-v1 about 2 months ago

My quants and experiment.

#1 opened about 2 months ago by ZeroWw
New activity in IlyaGusev/gemma-2-2b-it-abliterated 2 months ago

My quants and experiment.

#2 opened 2 months ago by ZeroWw
New activity in ZeroWw/gemma-2-2b-it-SILLY 2 months ago

Why Mistral?

2
#1 opened 2 months ago by sdalemorrey
New activity in google/gemma-2-2b-it 2 months ago

[solved] error downloading model!

11
#11 opened 2 months ago by ZeroWw
New activity in ZeroWw/gemma-2-2b-it-GGUF 2 months ago
New activity in google/gemma-2-2b-it 2 months ago
New activity in google/gemma-2b-it 2 months ago

ERROR DOWNLOADING

2
#49 opened 2 months ago by ZeroWw
New activity in mlabonne/TwinLlama-3.1-8B 2 months ago

My quants and silly experiment.

#2 opened 2 months ago by ZeroWw

My quants and my experiment.

#1 opened 2 months ago by ZeroWw
New activity in NeverSleep/Lumimaid-v0.2-12B 2 months ago

The "silly" experiment.

17
#4 opened 2 months ago by ZeroWw

My "silly" experiment.

5
#6 opened 2 months ago by ZeroWw

My alternative quantizations.

3
#3 opened 2 months ago by ZeroWw
New activity in NeverSleep/Lumimaid-v0.2-8B 2 months ago

My alternative quantizations.

5
#3 opened 2 months ago by ZeroWw
New activity in NeverSleep/Lumimaid-v0.2-8B 2 months ago

How about this dataset?

#6 opened 2 months ago by ZeroWw
New activity in nothingiisreal/L3.1-8B-Celeste-V1.5 2 months ago

The "silly" test.

7
#2 opened 2 months ago by ZeroWw
New activity in upstage/SOLAR-10.7B-Instruct-v1.0 2 months ago

The "silly" experiment.

#43 opened 2 months ago by ZeroWw

My alternative quantizations.

#42 opened 2 months ago by ZeroWw
New activity in nothingiisreal/L3.1-8B-Celeste-V1.5 2 months ago

My usual quants.

1
#1 opened 2 months ago by ZeroWw
New activity in NeverSleep/Lumimaid-v0.2-8B 2 months ago

The "silly" experiment.

#4 opened 2 months ago by ZeroWw
New activity in AI-MO/NuminaMath-7B-TIR 2 months ago

My alternative quantizations.

5
#5 opened 3 months ago by ZeroWw
New activity in ZeroWw/NuminaMath-7B-TIR-GGUF 2 months ago
New activity in TheDrummer/Gemmasutra-9B-v1 2 months ago

My "silly" experiment.

#2 opened 2 months ago by ZeroWw
New activity in mistralai/Mistral-7B-Instruct-v0.3 2 months ago

My "silly" experiment.

#66 opened 2 months ago by ZeroWw
New activity in ghost-x/ghost-8b-beta 2 months ago

My "silly" experiment.

#3 opened 2 months ago by ZeroWw
New activity in mistralai/Mistral-Nemo-Instruct-2407 2 months ago

Please release also a 7B-9B model!

#51 opened 2 months ago by ZeroWw

My "SILLY" experiment.

#50 opened 2 months ago by ZeroWw
New activity in mistralai/Mistral-Large-Instruct-2407 2 months ago

Is this "large" or "large2"?

6
#4 opened 2 months ago by ZeroWw
New activity in ZeroWw/Mistral-Nemo-Base-2407-GGUF 2 months ago
New activity in allenai/ZebraLogic 2 months ago

The problem with tests.

2
#1 opened 2 months ago by ZeroWw
New activity in meta-llama/Llama-3.1-8B-Instruct 2 months ago

My alternative quantizations.

7
#16 opened 2 months ago by ZeroWw
New activity in nothingiisreal/L3-8B-Celeste-V1.2 2 months ago

My quantizations.

2
#1 opened 2 months ago by ZeroWw
New activity in Symbol-LLM/Symbol-LLM-8B-Instruct 2 months ago

My alternative quantizations.

#1 opened 2 months ago by ZeroWw
New activity in meta-llama/Llama-Guard-3-8B 2 months ago

request still in "pending"

#10 opened 2 months ago by ZeroWw
New activity in mistralai/Mistral-7B-Instruct-v0.3 2 months ago
New activity in RobertSinclair/README 2 months ago

Space

3
#1 opened 3 months ago by Stark2008
New activity in Salesforce/xLAM-7b-fc-r 2 months ago

My alternative quantizations.

2
#1 opened 2 months ago by ZeroWw
New activity in ZeroWw/Mistral-Nemo-Instruct-2407-GGUF 2 months ago

8_p

1
#1 opened 2 months ago by maldv
New activity in ghost-x/ghost-8b-beta 2 months ago

My alternative quantizations.

1
#1 opened 2 months ago by ZeroWw
New activity in mistralai/Mistral-Nemo-Base-2407 2 months ago

My alternative quantizations.

#15 opened 2 months ago by ZeroWw