Remove temp directory again