Is it not acceptable to set a attribute not responding to a __init__ argument? I'm not sure of this by reading Coding guidelines. It looks like setting a redundant ( add solver_type in BaseLibLinear) or unused (class_weight_  in LinearSVR and epsilon in LinearSVC) will not cause trouble for methods of BaseEstimator.