MAHOUT-817 PCA options for SSVD (RC1)

git-svn-id: https://svn.apache.org/repos/asf/mahout/trunk@1292532 13f79535-47bb-0310-9956-ffa450edef68
MAHOUT-933: Refactored actual classification out of ClusterClassifier and into ClusteringPolicies. This
allows classifier to be completely generic as to the algorithm and gives policies correct use of e.g. fuzzyK 'm'
Introduced Canopy and MeanShift clustering policies for classification though not used by cluster iterator
Modified serialization of ClusterClassifiers to include ClusteringPolicy
Added ClusterClassifier serialization methods to exploded sequenceFile representation needed for MR
Updated Display examples and unit tests. All run

git-svn-id: https://svn.apache.org/repos/asf/mahout/trunk@1292563 13f79535-47bb-0310-9956-ffa450edef68
MAHOUT-933: Fixed undetected defects introduced by earlier commit.
I will run all the unit tests before every check-in
I will run all the unit tests before every check-in
I will run all the unit tests before every check-in
...

git-svn-id: https://svn.apache.org/repos/asf/mahout/trunk@1292629 13f79535-47bb-0310-9956-ffa450edef68
Minor namespace reorganization of ClusterIterator and related classes. All tests run

git-svn-id: https://svn.apache.org/repos/asf/mahout/trunk@1293712 13f79535-47bb-0310-9956-ffa450edef68
Subversive missed a few reorganization classes. all tests run

git-svn-id: https://svn.apache.org/repos/asf/mahout/trunk@1293713 13f79535-47bb-0310-9956-ffa450edef68
MAHOUT-931, MAHOUT-929. Added emitMostLikely and threshold based outlier removal capability in ClusterClassificationDriver.

git-svn-id: https://svn.apache.org/repos/asf/mahout/trunk@1293874 13f79535-47bb-0310-9956-ffa450edef68
MAHOUT-929, MAHOUT-931. Implemented mapreduce version of ClusterClassificationDriver with outlier removal capability.
Changed output of sequential to WeightedVectorWritable. Fixed and added test cases.

git-svn-id: https://svn.apache.org/repos/asf/mahout/trunk@1294454 13f79535-47bb-0310-9956-ffa450edef68
MAHOUT-980: Fix DistributedCache usage to allow EMR deployment

git-svn-id: https://svn.apache.org/repos/asf/mahout/trunk@1295352 13f79535-47bb-0310-9956-ffa450edef68
cleanups to make Jenkins a little happier

git-svn-id: https://svn.apache.org/repos/asf/mahout/trunk@1295424 13f79535-47bb-0310-9956-ffa450edef68
Doc typo fix

git-svn-id: https://svn.apache.org/repos/asf/mahout/trunk@1296164 13f79535-47bb-0310-9956-ffa450edef68
a few more cleanups to make Jenkins happier

git-svn-id: https://svn.apache.org/repos/asf/mahout/trunk@1296412 13f79535-47bb-0310-9956-ffa450edef68
Cleanups to address Jenkins violations

git-svn-id: https://svn.apache.org/repos/asf/mahout/trunk@1297298 13f79535-47bb-0310-9956-ffa450edef68
MAHOUT-982, Clustering vectors using ClusterClassificationDriver. Deleted ClusterMapper and its test cases.

git-svn-id: https://svn.apache.org/repos/asf/mahout/trunk@1298406 13f79535-47bb-0310-9956-ffa450edef68
MAHOUT-982, Formatted few newly added lines.

git-svn-id: https://svn.apache.org/repos/asf/mahout/trunk@1298408 13f79535-47bb-0310-9956-ffa450edef68
MAHOUT-933:
- refactored ClusteringPolicies into hierarchy under new AbstractClusteringPolicy
- added close() to ClusteringPolicy to allow policy-specific actions needed to compute convergence
- removed ClusteringPolicy from ClusterIterator constructor as ClusterClassifier already has one
- added convergence computations for kmeans and fuzzyk
- added final clustersOut renaming to add -final suffix
- updated Display examples and unit tests to reflect above
- all tests run

I think it is time to begin refactoring the buildClusters methods of the respective clustering drivers to use ClusterIterator as it seems to be producing equivalent results to the original implementations. This will involve removing a lot of existing driver, mapper and reducer code and many time-consuming unit tests. It will also have some impact on other components as the representation of clusters in the file system changes from Cluster to self-describing ClusterWritable.

git-svn-id: https://svn.apache.org/repos/asf/mahout/trunk@1298625 13f79535-47bb-0310-9956-ffa450edef68
MAHOUT-982, Added method and CLI option to remove outliers.

git-svn-id: https://svn.apache.org/repos/asf/mahout/trunk@1299207 13f79535-47bb-0310-9956-ffa450edef68
MAHOUT-822: Make Mahout compatible with Hadoop 0.23.1.


git-svn-id: https://svn.apache.org/repos/asf/mahout/trunk@1299770 13f79535-47bb-0310-9956-ffa450edef68
Attempt to fix test failure in TestDistributedRowMatrix

git-svn-id: https://svn.apache.org/repos/asf/mahout/trunk@1300196 13f79535-47bb-0310-9956-ffa450edef68
MAHOUT-981, MAHOUT-983. Refactored K-Means Clustering and Dirichlet Clustering to use ClusterClassificationDriver. 
Using cluster.getModel().configure() in ClusterClassificationDriver in order to configure DirichletCluster for MahalanobisDistanceMeasure. 
Added/fixed test cases by:
Using separate directories in test cases for supplying initial clusters and to store buildClusters to prevent two cluster-*-final files in the same directory.
Writing IntWritable in test cases instead of LongWritable ( As the ClusterClassificationDriver clusters records with IntWritable keys). 


git-svn-id: https://svn.apache.org/repos/asf/mahout/trunk@1301654 13f79535-47bb-0310-9956-ffa450edef68
MAHOUT-981, MAHOUT-983. Fixing test cases which fail intermittently. 
Build is passing on my machine ( even for the last commit ). 
Tried to identify all test cases, which can fail intermittently and fixed them.


git-svn-id: https://svn.apache.org/repos/asf/mahout/trunk@1301761 13f79535-47bb-0310-9956-ffa450edef68