Create the rules dir before writing templates to it