Added rate limiter for indexing