Article
Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference
•
67
Radoslav Gerganov
rgerganov
AI & ML interests
ggml, llama.cpp
Recent Activity
upvoted
an
article
about 1 month ago
Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference
liked
a model
about 1 month ago
microsoft/phi-4-gguf
updated
a Space
6 months ago
rgerganov/llama-rpc-server
Organizations
rgerganov's activity
upvoted
an
article
about 1 month ago
upvoted
an
article
6 months ago
Article
Introduction to ggml
•
147