GitHub repository: renswickd/semantic-prompt-cache
Primary language: Python
Created: 2025-06-08T10:22:18Z
Description: This app leverages Semantic Caching to minimize inference latency and reduce API costs by reusing semantically similar prompt responses.