scikit-learn/scikit-learn — Issue #598: ARDRegression -  array is too big error
Author: vicpara
Created: 2012-01-30 17:51:13+00:00
State: open

Hello,
When I run the ARDRegression algorithm I get the "array is too big" error. The data is indeed large about 113K records or 11 integer columns.
1. Is there a work around for this issue ?
2. Are there methods for the learner to load the data progressively ?
3. If I divide the data into chunks and train the algorithm sequentially what is the effect ? I know this sounds really stupid but how can I divide the work in smaller pieces.

Traceback (most recent call last):
File "\Program.py", line 58, in
clf.fit(input, target)
File "C:\Python27\lib\site-packages\sklearn\linear_model\bayes.py", line 401, in fit
sigma_ = linalg.pinv(np.eye(n_samples) / alpha_ +
File "C:\Python27\lib\site-packages\numpy\lib\twodim_base.py", line 210, in eye
m = zeros((N, M), dtype=dtype)
ValueError: array is too big.