TST: Install pandas using conda

Hopefully it will take a lot less time like this.