Clean-up cache during teardown

Signed-off-by: crynobone <crynobone@gmail.com>