system-test: support blocking rewrites

This must have gotten lost when I switched the config over.  Fixes #199.