Use both training and testing data to do cross validation
Delete some duplicated items