[PS-3176] Adding rails_config support