more features like continuous crawling
add database for testing
updated server for reliable performanc