muffinista/chatterbot — Issue #1: How to filter duplicate search result?
Author: millisami
Created: 2011-12-07 07:45:40+00:00
State: open

I setup the chatterbot search in a loop.

```rb
require 'chatterbot/dsl'
loop do
puts "Polling ... #{Time.now}"
search("'cloudfoundry'") do |tweet|
$stdout.puts tweet.inspect
end

sleep 60
end
```

But it always gets the same duplicate result. How to filter it out coz if I store it in DB, then the duplicate is aslo stored.

```rb
{:created_at=>"Wed, 07 Dec 2011 07:34:39 +0000", :from_user=>"UDCPStatus", :from_user_id=>425676094, :from_user_id_str=>"425676094", :from_user_name=>"UDCP Status", :geo=>nil, :id=>144318892062416896, :id_str=>"144318892062416896", :iso_language_code=>"ja", :metadata=>{:result_type=>"recent"}, :profile_image_url=>"http://a3.twimg.com/sticky/default_profile_images/default_profile_4_normal.png", :source=>"<a href="http://udcp.net/status/" rel="nofollow">Kiyoshi</a>", :text=>"【From http://t.co/ADejFNda】http://t.co/iE5YTJSv WEBサーバー正常稼働中です。 16:33:24", :to_user=>nil, :to_user_id=>nil, :to_user_id_str=>nil, :to_user_name=>nil}
{:created_at=>"Wed, 07 Dec 2011 07:34:37 +0000", :from_user=>"UDCPStatus", :from_user_id=>425676094, :from_user_id_str=>"425676094", :from_user_name=>"UDCP Status", :geo=>nil, :id=>144318884042915840, :id_str=>"144318884042915840", :iso_language_code=>"ja", :metadata=>{:result_type=>"recent"}, :profile_image_url=>"http://a3.twimg.com/sticky/default_profile_images/default_profile_4_normal.png", :source=>"<a href="http://udcp.net/status/" rel="nofollow">Kiyoshi</a>", :text=>"【From http://t.co/ADejFNda】http://t.co/2VOlnibh WEBサーバー正常稼働中です。 16:33:22", :to_user=>nil, :to_user_id=>nil, :to_user_id_str=>nil, :to_user_name=>nil}
```