rm unnecessary reshapes in InnerProductLayer