Before revision:  These linear transformations, along with simple nonlinearities in feed-forward layers, are sufficient to model semantic relationships in several text classification tasks.
After revision:  These linear transformations, along with standard nonlinearities in feed-forward layers, are sufficient to model semantic relationships in several text classification tasks.