Clean up install dirs on kafka