On 03/07/2013 05:18 AM, dclambert wrote:
>
> In benchmarks/bench_covertype.py:
>
> > @@ -227,6 +231,10 @@ def benchmark(clf):
> >                                                   n_jobs=opts.n_jobs,
> >                                                   random_state=opts.random_seed)
> >
> > +######################################################################
> > +## Train ELMClassifier model
> > +rhl = RBFRandomHiddenLayer(n_hidden=35, gamma=0.02, random_state=opts.random_seed)
>
> Had many memory issues trying to to do a grid search. The best score 
> that I was able to get was 0.2002 with 240 gaussian units. I was not 
> able to beat SGD with simple transfer functions before running out of 
> memory. The benchmark runs out of memory if I try to use the 240 unit 
> classifier with all of the other ones.
>
Maybe try another dataset, like MNIST or USPS.
I wasn't very successful with kernel approximations on this dataset either.