GitHub repository: 1712n/dedup-service
Primary language: TypeScript
Description: A high-performance service designed to eliminate duplicate and near-duplicate content, ensuring diversity and token uniqueness in datasets. Built on Cloudflare Workers.