Complex sentence: These models are shallow, two-layer neural networks, that are trained to reconstruct linguistic contexts of words: the network is shown a word, and must guess which words occurred in adjacent positions in an input text.
Split into simpler sentences: These models are shallow, two-layer neural networks, that are trained to reconstruct linguistic contexts of words. The network is shown a word, and must guess which words occurred in adjacent positions in an input text.