GitHub repository: sahilfaizal01/Large-Scale-Vector-DB
Primary language: Python
Created: 2024-12-09T22:50:43Z
Description: This project focuses on developing a scalable vector database system optimized for dense passage retrieval, leveraging the MS-MARCO v2 dataset containing 8.84 million passages. Using advanced big data technologies and vector indexing algorithms, the system addresses challenges of retrieval latency and accuracy in large-scale datasets.