Keep the puphpet/files/dot/ssh/ folder around.