The core technology behind Plucky.io, the crawler