added progress output to spider