[WIP] remove check_arrays stuff and old input validation

Follow-up on #3443, removing all the old stuff.
cosmit: I think it's more explicit to give the kwarg for 'csr' as well:

```python
X = check_array(X, allowed_sparse='csr', dtype=np.float64)
```