Actually this is probably not true from some loss such as MSE. For classification loss such as `'entropy'` that should hold, no?