Thor Lin
coolthor
AI & ML interests
On-device & edge LLM inference on NVIDIA GB10 / DGX Spark.
Quantization (NVFP4 W4A4/W4A16, FP8), vLLM serving, speculative
decoding (EAGLE-3), and multimodal/omni models. Measure-first
benchmarking — I publish the numbers, including the ones that fail.
Recent Activity
updated a model 8 days ago
coolthor/Huihui-gemma-4-26B-A4B-it-abliterated-FP8-Dynamic updated a model 8 days ago
coolthor/Huihui-Qwable-3.6-27b-abliterated-Q4_K_M-MTP-GGUF updated a model 8 days ago
coolthor/Huihui-Qwen3.6-35B-A3B-abliterated-FP8-DYNAMICOrganizations
None yet
Model hallucinates
2
#1 opened about 2 months ago
by 
johnlockejrr