Part of the problem might be that we load covertype as an ndarray, while it's quite sparse. But we can't load it as CSR because that breaks the random forests.