tokens: In this paper , we propose a Product - based Neural Networks ( PNN ) with an embedding layer to learn a distributed representation of the categorical data , a product layer to capture interactive patterns between inter - field categories , and further fully connected layers to explore high - order feature interactions .