Allow our package test config path to be persisted