Before revision:   Innovative outputs suggest that phonetic and phonological representations learned by the network can be productively recombined and directly paralleled to productivity in human speech: a fiwGAN network trained on ' suit' and ' dark' outputs innovative ' start', even though it never saw ' start' or even a [st] sequence in the training data.
After revision:  The network occasionally outputs innovative lexical items that violate training data, but are linguistically interpretable and highly informative for cognitive modeling and neural network interpretability. Innovative outputs suggest that phonetic and phonological representations learned by the network can be productively recombined and directly paralleled to productivity in human speech: a fiwGAN network trained on ' suit' and ' dark' outputs innovative ' start', even though it never saw ' start' or even a [st] sequence in the training data.