Revert parts of e1ab2f7a, the depchain got perturbed again

Latest strictures now instist on bringing in the extra deps, which can't
be installed without working configure_requires