updated implementation for SpamBot and added initial crawler implementation