added rate limit check as well and making sure we don't pull duplicate tweets