Revert "set classifier slot dirty after training"

This reverts commit f72099a86d2872e7ba3652a0b44294ab2337f353.

This was done so that the serializer would know that the cached
classifier has changed. However, it is the wrong way to go about it.
We need some other mechanism for operators with caches.