GSoC 2014: Standard Extreme Learning Machines

Finished implementing the standard extreme learning machines (ELMs). I am getting the following results with 550 hidden neurons against the digits datasets,

Training accuracy using the logistic activation function: 0.999444
Training accuracy using the tanh activation function: 1.000000

Fortunately, this algorithm is much easier to implement and debug than multi-layer perceptron :).
I will push a test file soon.

@ogrisel , @larsmans
This examples first demonstrate how to use the scikit-learn `GridsearchCV` to tune the 3 most impacting hyperparameters of the ELM classifiers.

Then we visualize the hyper parameter space around the best model by varying 2 parameters for each plot while keeping the third one to its optimal value.