Kusawa kusawa

sunnykusawa's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

New activity in MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF 3 months ago

unable to load quantized 4bit_m

3

#5 opened 3 months ago by sunnykusawa

New activity in meta-llama/Llama-3.1-8B-Instruct 3 months ago

unable to load 4-bit quantized varient with llama.cpp

#31 opened 3 months ago by sunnykusawa

New activity in mistralai/Mixtral-8x7B-Instruct-v0.1 7 months ago

Input token size issue, does it realy supports 32k tokens?

1

#197 opened 7 months ago by sunnykusawa

Input validation error: `inputs` tokens + `max_new_tokens` must be <= 2048. on Mixtral8x7b 32K token

2

#199 opened 7 months ago by sunnykusawa

New activity in TheBloke/CodeLlama-13B-Instruct-GGUF 7 months ago

Deploy Quantized model on AWS Sagemaker

#4 opened 7 months ago by sunnykusawa