GitHub repository: zanachka/atrax
Description: Atrax is a distributed auto-scaling web crawler that runs on AWS.