system-test: support blocking rewrites (fixes #199)

This must have gotten lost when I switched the config over.