Remove h5py from intersphinx and add pandas

This needs to be merged asap as it fixes the travis build.