Strip dependency on pypandoc

Building the .rst is not really a necessary step of the build. So get
rid of it to be more portable.