tokens: Among the NN variants of FM , the product - based neural network ( PNN)product - based - nn has been known to effectively capture the higher - order interactions between the categorical variables by applying pairwise product operations for each possible pair of embedded categorical fields and passing the resulting vector as the input to a NN .