Crawler piping optimitized

Unnessesary function removed
Error handeling