Refactor of crawler

Signed-off-by: Ozan Turgut <ozanturgut@gmail.com>