| ```bash | |
| % python ask.py -c -q "Why do we need agentic RAG even if we have ChatGPT?" | |
| 2024-11-20 10:03:49,810 - INFO - Initializing converter ... | |
| 2024-11-20 10:03:49,810 - INFO - ✅ Successfully initialized Docling. | |
| 2024-11-20 10:03:49,810 - INFO - Initializing chunker ... | |
| 2024-11-20 10:03:50,052 - INFO - ✅ Successfully initialized Chonkie. | |
| 2024-11-20 10:03:50,414 - INFO - Initializing database ... | |
| 2024-11-20 10:03:50,544 - INFO - ✅ Successfully initialized DuckDB. | |
| 2024-11-20 10:03:50,545 - INFO - Searching the web ... | |
| 2024-11-20 10:03:51,239 - INFO - ✅ Found 10 links for query: Why do we need agentic RAG even if we have ChatGPT? | |
| 2024-11-20 10:03:51,239 - INFO - Scraping the URLs ... | |
| 2024-11-20 10:03:51,239 - INFO - Scraping https://community.openai.com/t/how-to-use-rag-properly-and-what-types-of-query-it-is-good-at/658204 ... | |
| 2024-11-20 10:03:51,240 - INFO - Scraping https://www.reddit.com/r/LangChain/comments/1ey94rs/is_rag_still_a_thing/ ... | |
| 2024-11-20 10:03:51,242 - INFO - Scraping https://community.openai.com/t/prompt-engineering-for-rag/621495 ... | |
| 2024-11-20 10:03:51,242 - INFO - Scraping https://www.linkedin.com/posts/elijahbutler_can-you-use-chat-gpt-as-a-data-analyst-activity-7227666801688461312-qk6v ... | |
| 2024-11-20 10:03:51,243 - INFO - Scraping https://www.reddit.com/r/ChatGPTCoding/comments/1cft751/my_experience_with_github_copilot_vs_cursor/ ... | |
| 2024-11-20 10:03:51,244 - INFO - Scraping https://www.ben-evans.com/benedictevans/2024/6/8/building-ai-products ... | |
| 2024-11-20 10:03:51,244 - INFO - Scraping https://news.ycombinator.com/item?id=40739982 ... | |
| 2024-11-20 10:03:51,245 - INFO - Scraping https://www.linkedin.com/posts/andrewyng_github-andrewyngtranslation-agent-activity-7206347897938866176-5tDJ ... | |
| 2024-11-20 10:03:51,247 - INFO - Scraping https://medium.com/@sandyshah1990/starting-to-learn-agentic-rag-e7ec916c83a2 ... | |
| 2024-11-20 10:03:51,248 - INFO - Scraping https://www.linkedin.com/posts/kurtcagle_agentic-rag-personalizing-and-optimizing-activity-7198097129993613312-z7Sm ... | |
| 2024-11-20 10:03:51,836 - INFO - ✅ Successfully scraped https://www.ben-evans.com/benedictevans/2024/6/8/building-ai-products with length: 8824 | |
| 2024-11-20 10:03:51,839 - INFO - ✅ Successfully scraped https://medium.com/@sandyshah1990/starting-to-learn-agentic-rag-e7ec916c83a2 with length: 18260 | |
| 2024-11-20 10:03:51,852 - INFO - ✅ Successfully scraped https://community.openai.com/t/how-to-use-rag-properly-and-what-types-of-query-it-is-good-at/658204 with length: 9895 | |
| 2024-11-20 10:03:51,869 - INFO - ✅ Successfully scraped https://community.openai.com/t/prompt-engineering-for-rag/621495 with length: 21898 | |
| 2024-11-20 10:03:52,038 - INFO - ✅ Successfully scraped https://news.ycombinator.com/item?id=40739982 with length: 122350 | |
| 2024-11-20 10:03:52,227 - INFO - ✅ Successfully scraped https://www.linkedin.com/posts/andrewyng_github-andrewyngtranslation-agent-activity-7206347897938866176-5tDJ with length: 35845 | |
| 2024-11-20 10:03:52,425 - INFO - ✅ Successfully scraped https://www.linkedin.com/posts/kurtcagle_agentic-rag-personalizing-and-optimizing-activity-7198097129993613312-z7Sm with length: 24524 | |
| 2024-11-20 10:03:52,480 - INFO - ✅ Successfully scraped https://www.linkedin.com/posts/elijahbutler_can-you-use-chat-gpt-as-a-data-analyst-activity-7227666801688461312-qk6v with length: 25621 | |
| 2024-11-20 10:03:52,949 - INFO - ✅ Successfully scraped https://www.reddit.com/r/ChatGPTCoding/comments/1cft751/my_experience_with_github_copilot_vs_cursor/ with length: 5138 | |
| 2024-11-20 10:03:52,996 - INFO - ✅ Successfully scraped https://www.reddit.com/r/LangChain/comments/1ey94rs/is_rag_still_a_thing/ with length: 2486 | |
| 2024-11-20 10:03:52,996 - INFO - ✅ Scraped 10 URLs. | |
| 2024-11-20 10:03:52,996 - INFO - Chunking the text ... | |
| 2024-11-20 10:03:53,044 - INFO - ✅ Generated 75 chunks ... | |
| 2024-11-20 10:03:53,044 - INFO - Saving 75 chunks to DB ... | |
| 2024-11-20 10:03:53,065 - INFO - Embedding 10 batches of chunks ... | |
| 2024-11-20 10:03:54,563 - INFO - ✅ Finished embedding. | |
| 2024-11-20 10:03:55,583 - INFO - ✅ Created the vector index ... | |
| 2024-11-20 10:03:55,677 - INFO - ✅ Created the full text search index ... | |
| 2024-11-20 10:03:55,679 - INFO - ✅ Successfully embedded and saved chunks to DB. | |
| 2024-11-20 10:03:55,679 - INFO - Querying the vector DB to get context ... | |
| 2024-11-20 10:03:56,092 - INFO - Running full-text search ... | |
| 2024-11-20 10:03:56,118 - INFO - ✅ Got 15 matched chunks. | |
| 2024-11-20 10:03:56,118 - INFO - Running inference with context ... | |
| 2024-11-20 10:04:00,968 - INFO - ✅ Finished inference API call. | |
| 2024-11-20 10:04:00,969 - INFO - Generating output ... | |
| # Answer | |
| Agentic RAG (Retrieval-Augmented Generation) is necessary even with the existence of ChatGPT due to its multi-faceted capabilities that enhance the overall processing and retrieval of information. Specifically, Agentic RAG employs multiple agents that can manage retrieval tasks, document comparisons, and even perform specific operations like calculations, which are not inherently available in a single model like ChatGPT. This allows for a more streamlined and efficient process when addressing complex queries that require synthesis from various data points, ensuring that no critical context is lost during retrieval and generation processes[1][4]. Additionally, RAG's framework allows for greater flexibility and precision in handling varied types of queries, especially those that require comparative analysis or handling large volumes of data that exceed typical model limitations[2][5][6]. Furthermore, it enables the use of specialized agents that can focus on unique tasks, making the whole system more dynamic and capable of tackling intricate demands in real-time applications[4][6]. | |
| In short, while ChatGPT offers robust conversational capabilities, the agentic approach of RAG significantly broadens the scope and effectiveness of information processing for complex tasks. | |
| # References | |
| [1] https://community.openai.com/t/how-to-use-rag-properly-and-what-types-of-query-it-is-good-at/658204 | |
| [2] https://community.openai.com/t/how-to-use-rag-properly-and-what-types-of-query-it-is-good-at/658204 | |
| [3] https://community.openai.com/t/prompt-engineering-for-rag/621495 | |
| [4] https://community.openai.com/t/how-to-use-rag-properly-and-what-types-of-query-it-is-good-at/658204 | |
| [5] https://news.ycombinator.com/item?id=40739982 | |
| [6] https://www.linkedin.com/posts/elijahbutler_can-you-use-chat-gpt-as-a-data-analyst-activity-7227666801688461312-qk6v | |
| [7] https://community.openai.com/t/prompt-engineering-for-rag/621495 | |
| [8] https://news.ycombinator.com/item?id=40739982 | |
| [9] https://www.linkedin.com/posts/elijahbutler_can-you-use-chat-gpt-as-a-data-analyst-activity-7227666801688461312-qk6v | |
| [10] https://www.linkedin.com/posts/elijahbutler_can-you-use-chat-gpt-as-a-data-analyst-activity-7227666801688461312-qk6v | |
| [11] https://community.openai.com/t/prompt-engineering-for-rag/621495 | |
| [12] https://news.ycombinator.com/item?id=40739982 | |
| [13] https://news.ycombinator.com/item?id=40739982 | |
| [14] https://news.ycombinator.com/item?id=40739982 | |
| [15] https://news.ycombinator.com/item?id=40739982 | |
| ``` | |