Xuan Son NGUYEN's picture

Xuan Son NGUYEN

ngxson

·

https://blog.ngxson.com

AI & ML interests

Doing AI for fun, not for profit

Recent Activity

liked a model 3 days ago

Datou1111/shou_xin

liked a Space 3 days ago

akhaliq/anychat

updated a model 9 days ago

ggml-org/jina-embeddings-v2-base-code-Q8_0-GGUF

View all activity

Articles

Introducing GGUF-my-LoRA

Code a simple RAG from scratch

Introduction to ggml

Organizations

ngxson's activity

New activity in ggml-org/gguf-my-repo 10 days ago

Accessing own private repos

#141 opened 17 days ago by

New activity in ggml-org/gguf-my-repo 16 days ago

[Errno 2] No such file or directory: './llama.cpp/llama-quantize'

#140 opened 19 days ago by

New activity in ggml-org/gguf-my-repo about 1 month ago

Error quantizing: b'/bin/sh: 1: ./llama.cpp/llama-quantize: not found\n'

#136 opened about 1 month ago by

Better isolation + various improvements

#133 opened about 2 months ago by

New activity in ggml-org/gguf-my-repo about 2 months ago

update readme for card generation

#128 opened 2 months ago by

Error converting to fp16: b'INFO:hf-to-gguf:Loading model: qwen2.5-3b

#135 opened about 2 months ago by

Qwen2.5-3B: [Errno 2] No such file or directory: 'downloads/tmpg0g5sjvl'

#134 opened about 2 months ago by

add docker compose for dev locally

#130 opened about 2 months ago by

Add F16 and BF16 quantization

#129 opened about 2 months ago by

Update app.py

#132 opened about 2 months ago by

New activity in HuggingFaceTB/SmolLM2-1.7B-Instruct about 2 months ago

Update README.md

#6 opened about 2 months ago by

New activity in mlabonne/Llama-3.1-70B-Instruct-lorablated about 2 months ago

LoRA-only GGUF

#4 opened 5 months ago by

New activity in ggml-org/gguf-my-repo about 2 months ago

throw an error if selected model is PEFT

#131 opened about 2 months ago by

Issue converting PEFT LoRA fine tuned model to GGUF

#124 opened 3 months ago by

New activity in nvidia/Mistral-NeMo-Minitron-8B-Instruct 2 months ago

Incorrect chat template?

#5 opened 2 months ago by

New activity in llava-hf/llava-1.5-7b-hf 3 months ago

populate "text_config"

#34 opened 3 months ago by

New activity in ggml-org/gguf-my-repo 4 months ago

mamba codestral support ?

#118 opened 4 months ago by

no gpu

#119 opened 4 months ago by

Please, update converting script. Llama.cpp added support for Nemotron and Minitron architectures.

#111 opened 4 months ago by

New activity in google/shieldgemma-2b 5 months ago

Suggestion: Better KV cache usage

#8 opened 5 months ago by