Prepare for softmax

Signed-off-by: Zhou Chang <achang.zhou@gmail.com>