Move puppet related files under a puppet directory