hang softmax loss off each side