Makes sure tempfile manager removes its temporary files directory