ENH: ability to handle non-nan sparse values