Before revision:  Our observations motivate the need to formalize and verify common assumptions in interpretability , while our ] evaluation framework and synthetic dataset serve as a testbed to rigorously analyze instance-specific interpretability methods.
After revision:  Our observations motivate the need to formalize and verify common assumptions in interpretability , while our ] evaluation framework and BlockMNIST-based datasets can serve as sanity checks to audit instance-specific interpretability methods.