Remove python

This PR includes the commit in #481 as well (as the changes in the manual builds on top of that one).