Changed path of test files in preprocess.properties
Changed main method in PRF1Measure to find accuracy for new models and test data
Added constants file with path to properties file
All files use this constant now instead of setting private constants
Fixed magic number problem - DatasetSplitter now splits according to the split ratio
Properties file path in ConfigConstants now used as constants in other files
Fixed error in replacing special double quotes
Added methods to TextUtility to effectively find user mentions even if they're in the middle of a word
Changed isReply method so that it always searches for "@ at the start of a token to flag the tweet as a reply.
Changed isReply method so that it always searches for "@ at the start of a token to flag the tweet as a reply.
Minor aesthetic to TextUtility
Fixed a problem with reformatting user mentions - ignores all tweets where many user mentions are strung together or can't be parsed
Changed naming convention for output file from filter
Changed naming convention for output file from filter
Wrote method to get frequencies of tokens from files
Added method to strip punctuation from word to help with vocabulary creation
Added code to write the vocabulary map to a path specified by the new VOCABULARY_FILE property in the properties file.
- Added code to quickly reduce the size of a dataset (all methods in the class DatasetTrimmer)
- Dataset created now has equal number of positive and negative tweets
- Added class to calculate the distribution of hashtags in a dataset
- Changed format of F-1 measure output