PLAT-3972 - Put config directory on main classpath

Cherry picked from d4acaba51bc9fae3686a14cdcf9889cdd9908b28