Added the crawler files

Signed-off-by: Arne Schreuder <arne@consulta.co.za>