Reintroduce exp decaying weights config.