Let python extra dependencies fail on error

This will uncover that some dependencies are not installing correctly at the moment...