AI & ML interests

Self-hosted, GPU-pooling LLM inference run your own model fleet on your own hardware. One streaming, OpenAI-compatible API over transformers & llama.cpp. Inference you own.

Recent Activity

putkoff  updated a Space 29 days ago
hugpy-ai/hugpy-chat
putkoff  updated a Space 29 days ago
hugpy-ai/hugpy-console
putkoff  updated a Space 29 days ago
hugpy-ai/hugpy
View all activity

hugpy-ai 's models

None public yet