ME 1
AIGUYCONTENT
AI & ML interests
None yet
Organizations
None yet
AIGUYCONTENT's activity
136GB VRAM enough to run Q8?
10
#1 opened 5 days ago
by
AIGUYCONTENT
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6535601a5f5e918bdc08d0d2/ElWiwLfKV_qL_uHP82L2t.jpeg)
Files empty?
3
#2 opened 5 days ago
by
AIGUYCONTENT
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6535601a5f5e918bdc08d0d2/ElWiwLfKV_qL_uHP82L2t.jpeg)
Intelligence difference between Q6_K and i1-Q6_K?
1
#1 opened 11 days ago
by
AIGUYCONTENT
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6535601a5f5e918bdc08d0d2/ElWiwLfKV_qL_uHP82L2t.jpeg)
Template?
#2 opened 16 days ago
by
AIGUYCONTENT
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6535601a5f5e918bdc08d0d2/ElWiwLfKV_qL_uHP82L2t.jpeg)
Instruction template?
2
#2 opened 17 days ago
by
AIGUYCONTENT
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6535601a5f5e918bdc08d0d2/ElWiwLfKV_qL_uHP82L2t.jpeg)
Duplicate leading "<|begin_of_text|>" in prompt error (Oobabooga)
1
#2 opened 19 days ago
by
AIGUYCONTENT
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6535601a5f5e918bdc08d0d2/ElWiwLfKV_qL_uHP82L2t.jpeg)
Does not run in Oobabooga?
1
#5 opened 21 days ago
by
AIGUYCONTENT
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6535601a5f5e918bdc08d0d2/ElWiwLfKV_qL_uHP82L2t.jpeg)
120GB of VRAM enough to run this model?
1
#237 opened 21 days ago
by
AIGUYCONTENT
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6535601a5f5e918bdc08d0d2/ElWiwLfKV_qL_uHP82L2t.jpeg)
Detected duplicate leading "<|begin_of_text|>" in prompt
3
#2 opened 23 days ago
by
AIGUYCONTENT
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6535601a5f5e918bdc08d0d2/ElWiwLfKV_qL_uHP82L2t.jpeg)
Tried Llama 3.1 70B?
2
#5 opened 28 days ago
by
noisefloordev
Llama 3.1 70B Abliterated
1
#194 opened 24 days ago
by
AIGUYCONTENT
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6535601a5f5e918bdc08d0d2/ElWiwLfKV_qL_uHP82L2t.jpeg)
Abliterated quant?
4
#7 opened 25 days ago
by
AIGUYCONTENT
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6535601a5f5e918bdc08d0d2/ElWiwLfKV_qL_uHP82L2t.jpeg)
Oobabooga?
1
#1 opened 25 days ago
by
AIGUYCONTENT
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6535601a5f5e918bdc08d0d2/ElWiwLfKV_qL_uHP82L2t.jpeg)
Q6 doesn't work.
1
#2 opened about 1 month ago
by
AIGUYCONTENT
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6535601a5f5e918bdc08d0d2/ElWiwLfKV_qL_uHP82L2t.jpeg)
GGUF quants pl0x
1
#5 opened about 1 month ago
by
AIGUYCONTENT
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6535601a5f5e918bdc08d0d2/ElWiwLfKV_qL_uHP82L2t.jpeg)
How to run this on iPhone 14 Pro Max?
#2 opened about 1 month ago
by
AIGUYCONTENT
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6535601a5f5e918bdc08d0d2/ElWiwLfKV_qL_uHP82L2t.jpeg)
Error: "Transformers does not recognize this architecture."
2
#1 opened about 2 months ago
by
AIGUYCONTENT
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6535601a5f5e918bdc08d0d2/ElWiwLfKV_qL_uHP82L2t.jpeg)
OOM when trying to load the Q8 in Oobabooga (I have 98GB VRAM)
2
#1 opened about 2 months ago
by
AIGUYCONTENT
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6535601a5f5e918bdc08d0d2/ElWiwLfKV_qL_uHP82L2t.jpeg)
What hardware you use
1
#8 opened 4 months ago
by
Jonvas
Error when trying to run in OobaBooga
5
#1 opened 2 months ago
by
AIGUYCONTENT
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6535601a5f5e918bdc08d0d2/ElWiwLfKV_qL_uHP82L2t.jpeg)
No files when downloading?
3
#1 opened 3 months ago
by
AIGUYCONTENT
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6535601a5f5e918bdc08d0d2/ElWiwLfKV_qL_uHP82L2t.jpeg)
Not downloading
1
#1 opened 3 months ago
by
AIGUYCONTENT
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6535601a5f5e918bdc08d0d2/ElWiwLfKV_qL_uHP82L2t.jpeg)
Will this run on a 4090 and 64GB of DDR5?
2
#6 opened 3 months ago
by
AIGUYCONTENT
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6535601a5f5e918bdc08d0d2/ElWiwLfKV_qL_uHP82L2t.jpeg)
Can you guys make a merge that writes naturally as a human being?
1
#2 opened 3 months ago
by
AIGUYCONTENT
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6535601a5f5e918bdc08d0d2/ElWiwLfKV_qL_uHP82L2t.jpeg)
How to join the Q6 files?
11
#2 opened 4 months ago
by
AIGUYCONTENT
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6535601a5f5e918bdc08d0d2/ElWiwLfKV_qL_uHP82L2t.jpeg)