OK, I think that the way to go here is layer entropy as the only new factor. I think this weight works well for it, according to my experiments.