Only backup the last old chef client file