[MultiConf] Handle multiple conf files more conveniently