Add pillar with rails versions.