Remove scale from optimizer. Do it yourself.