Fix failure with using pandas as Numpy index