Autonomous AI agents and scraping for data gathering
Channel: Practical AI through Prototypes
Date: 2023-12-20

In this video I'll walk through some code built to automate a set of interactions with a specific website in order to generate data for ML model training, using the javascript library Puppeteer. 

I'll then take a look at autonomous AI agents (using autoGPT) that can be employed with less prescriptive instructions to help facilitate the data gathering process. 

CODE
Scraper Code - Final - https://gist.github.com/heaversm/17571532b84ac448a400512b23fe246e
Scraper Code generated by chatGPT - https://gist.github.com/heaversm/5507951271341616ea07648614360af1

LINKS
autogpt website - https://news.agpt.co/
codebase - https://github.com/Significant-Gravitas/AutoGPT
evo.ninja - https://evo.ninja/
hard fork episode - "AI is eating the internet" - https://www.nytimes.com/2023/12/01/podcasts/hard-fork-openai-future-binance.html

About Me: I am a Staff Design Technologist on Mozilla's Innovation Team. Learn more about Mozilla Innovation at future.mozilla.org

0:00 context - Automated SEO heists on Hard Fork
0:48 - automating transcription using AI and web scraping
2:42 - generating scraper code with chatgpt
4:46 - web scraper process walkthrough
6:25 - making the necessary modifications to chatGPT code
8:32 - adding the ability to download data from multiple sources
9:45 - using existing AI tools to generate your list of content sources
10:33 - autonomous AI agents and autogpt for intuitive problem solving
13:17 - prompt engineering for autonomous agents
15:54 - anatomy of an agent

#ai #mozilla #puppeteer #autogpt #education #chatgpt #bardeen