committing so I can pull
Merge branch 'master' of https://github.com/etosch/SurveyMan
Fixed toString call
going to merge
merging
Untested entropy metric in QCMetrics
QCMetric compiles, but doesn't correctly id outliers generated by TestSuite. Changing my test csv to see if I can get better results.
Fixed some errors in QCMetrics, it still doesn't work though
Added new class specifically to test entropy metric on Emery's survey due to parsing issues. Metric still classifies all responses as random, so there must be something wrong with my implementation.
Figured out entropy metric issue, I was returning the wrong list (read: I'm an idiot). Messed around with the threshold T value because when it was set to 5, nothing was classified as an outlier. Right now I have it at 3, which seems to work well for my generated test data, less well for Emery's survey data. Not sure how to generate an optimal threshold T, since it seems like it would be specific to the data set.
Emery's entropy code/test files (from experimental folder)
committing before pulling in from public;
Merge branch 'master' of github.com:etosch/SurveyMan
Fixed paths and added some signal to noise tests. TestSuite now gradually increases the ratio of random to real respondents, just to see how the metric's efficacy deteriorates.
New classes for data visualization. One to parse generated survey responses back to a csv, the other to perform analysis on it (in python)
Prints probability density function graphs to a pdf file, not sure it works right because the graphs look a bit funky. Uses scipy gaussian_kde method, maybe find a different one?
Added bootstrap to determine answer distribution, added correlation heatmap. Frequency histograms not working yet.
Fixed heatmap so it has a colorbar. Working on hist stuff.
Added frequency bar chart, trying to improve it/add standard dev to it
New method of determining threshold, T test correction