Remove the rewrite_config feature.

It was only there due to historical reasons, we no longer rely on it,
its nasty, it should go.