Passing data from Python to Perl
Python is being used call the LDA code and return a small list of similar
entries as a JSON object. Perl then decodes that JSON object and iterates
through it.
More information is now being retrieved from the query.
In particular, the relevance score for each entry can now be obtained.
More manipulation plus comparison of both lists.
Started adding entries to the relations table.
Just going with the entries that appear in both lists for now and using
a bogus rank value.
Stashing recent changes before making a major change.
A lot of this code is working now.
Still need to generalize it to accept more entries and clean up
some things (e.g. author name(s)), but it's getting there.
Laying groundwork for more entry IDs.
2 entries are now added to the soup.html file.
i.e. the code is now more generalized.
Lots of improvements and optimizations
Factoring the combination functionality out.
Fixed the minimum/maximum score calculation
The variables are no longer initialized upon declaration. Instead a check
is made to see if they are defined, and if not, they are simply assigned
the first score that is encountered. This fixes the issue:
"I'm not sure the way you calculate $minScore is safe. there could be
no score below 100, which would result in the wrong minScore value."
Meaningful variable names for LDA min/max scores.
Also moved the Python code to the end of the file. Both of these changes
should help improve readability.
New script
Just starting to get things organized the way David wants.
New files
train.py is empty for now.
similar-lda.pl is simply similarCombination.pl renamed.
Adding Python scripts from my PC
Changed the context type to 'article'
Hopefully this will allow things to work properly later.
All code for LDA/legacy similarity should now be in lib/lda.
Rolling back to previous version.
Rolling back to a previous version.
Removed some hardcoded values
It is now possible to specify the corpus and model files, as well as a prefix
for the output files, on the command line.