Loosen the requirements on joblib