Hello Nikitsaraf,

that comment is not written by me. I did not change tfidf (I believe). Does it run in your version? Maybe there is a wrong version on GIT?

 

 

 

Kind Regards

Stephan

 

Von: nikitsaraf [mailto:notifications@github.com] 
Gesendet: Mittwoch, 7. August 2013 00:29
An: open-city/dedupe
Cc: Gaptor
Betreff: Re: [dedupe] Proof of Concept for Data matching (#132)

 

In dedupe/tfidf.py:

>  
>      inverted_index = defaultdict(lambda : defaultdict(list))
>      token_vector = defaultdict(dict)
>      corpus_ids = set([])
>  
>      for (record_id, record) in data:
> -        corpus_ids.add(record_id)  # candidate for removal
> +        if constrained_matching:

Sorry, but I do not get your comment.

—
Reply to this email directly or view it on GitHub <https://github.com/open-city/dedupe/pull/132/files#r5618651> .  <https://github.com/notifications/beacon/bCEsWHjePrsRUUftUVxk6l3jzZ35sPvNB2Mp-PRA5ywmlhnnJIz9vhtoE8i3G-4a.gif>