aws-solutions-library-samples/guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eks: Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference and GPU instances for accelerated inference. Guidance provides a complete end-to-end platform for deploying LLMs with agentic AI capabilities, including RAG and MCP
Language: Python
Topics: agentic-ai, agentic-workflow, huggingface, inference, inference-engine, langfuse, litellm-ai-gateway, mcp-client, mcp-server, opensource-ai, vllm
Category: agentic-ai-frameworks