Fix #64572: Clean up after the test

Lets not leave stuff lying around.
Fix #64572: Clean up after the test

Lets not leave stuff lying around.