Added seed option for the generation of the random sample
Added more regular expressions to discard more meaningless words
removing the file stemming_tmp.py
Stemming functions for a string and a list of strings which includes everything: stopwords, abbreviations, ngrams, tokenizer and stemming
At the moment stemmer=English and tokenizer=Punktword, although this can be costumize at any time
The stemming functions have been removed and a new function added:
customizeDic() which loads an existing dicitonary and customize it
New function which loads a dictionary and creates a corpus (bow) from the raw email text based on that dictionary.
Trying to solve the conflict
Trying to fix the merge
Trying to fix the changes
Updates in different files
Merge pull request #18 from elenagr/master

Modify create dictionary and new function for corpus