Why setting `max_depth=1` by default? This will make a very poor ensemble. `DecisionTreeClassifier()` with all default parameter  values  would be better. The same goes for `DecisionTreeRegressor()` below.